Apr 09 13:24:18 devstack cinder-volume[72262]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 09 13:24:18 devstack cinder-volume[72262]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 13:24:18 devstack cinder-volume[72262]: we strongly recommend against using it for new projects. Apr 09 13:24:18 devstack cinder-volume[72262]: If you are already using Eventlet, we recommend migrating to a different Apr 09 13:24:18 devstack cinder-volume[72262]: framework. For more detail see Apr 09 13:24:18 devstack cinder-volume[72262]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 13:24:18 devstack cinder-volume[72262]: import eventlet # noqa Apr 09 13:24:20 devstack cinder-volume[72262]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 13:24:20 devstack cinder-volume[72262]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 13:24:20 devstack cinder-volume[72262]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 13:24:21 devstack cinder-volume[72262]: INFO dbcounter [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Registered counter for database cinder Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_db.sqlalchemy.engines [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72262) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG dbcounter [-] [72262] Writer thread running {{(pid=72262) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 13:24:21 devstack cinder-volume[72262]: INFO cinder.rpc [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 09 13:24:21 devstack cinder-volume[72262]: INFO cinder.rpc [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_db.sqlalchemy.engines [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72262) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:24:21 devstack cinder-volume[72262]: INFO cinder.volume.manager [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Determined volume DB was empty at startup. Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG cinder.volume.manager [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72262) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 09 13:24:21 devstack cinder-volume[72262]: INFO cinder.volume.manager [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 09 13:24:21 devstack cinder-volume[72262]: WARNING stevedore.named [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 13:24:21 devstack cinder-volume[72262]: WARNING castellan.key_manager [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 13:24:21 devstack cinder-volume[72262]: WARNING cinder.keymgr.conf_key_mgr [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG cinder.volume.drivers.lvm [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72262) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_concurrency.processutils [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_concurrency.processutils [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] CMD "cinder-rtstool verify" returned: 0 in 0.254s {{(pid=72262) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_db.sqlalchemy.engines [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72262) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:24:21 devstack cinder-volume[72262]: INFO cinder.rpc [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 09 13:24:21 devstack cinder-volume[72262]: INFO cinder.rpc [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 09 13:24:21 devstack cinder-volume[72262]: WARNING stevedore.named [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 13:24:21 devstack cinder-volume[72262]: WARNING castellan.key_manager [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 13:24:21 devstack cinder-volume[72262]: INFO cinder.volume.manager [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_db.sqlalchemy.engines [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72262) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:24:21 devstack cinder-volume[72262]: INFO oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Starting 1 workers Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Started child 72367 {{(pid=72262) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Full set of CONF: {{(pid=72262) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] ******************************************************************************** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Configuration options gathered from: {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] ================================================================================ {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] allow_availability_zone_fallback = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] allow_compression_on_image_upload = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] allowed_direct_url_schemes = [] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] api_rate_limit = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] auth_strategy = keystone {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] az_cache_duration = 3600 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_availability_zone = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_host = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_name = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_stats_polling_interval = 60 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backup_api_class = cinder.backup.api.API {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backup_name_template = backup-%s {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backup_use_same_host = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backup_use_temp_snapshot = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] chap_password = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] chap_username = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cinder_internal_tenant_project_id = 9eae7f264dc245d2bc1ba918ea81fb8d {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cinder_internal_tenant_user_id = 5ab1d62b5ae345e58dc262fd793c8f63 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cloned_volume_same_az = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cluster = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] compression_format = gzip {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] compute_api_class = cinder.compute.nova.API {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72367]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] config_dir = [] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] config_source = [] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] control_exchange = openstack {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] debug = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] default_availability_zone = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] default_group_type = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] default_volume_type = lvmdriver-1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] disk_geometry = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] driver_client_cert = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] driver_client_cert_key = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] driver_data_namespace = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] driver_ssl_cert_path = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] driver_ssl_cert_verify = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] driver_use_ssl = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] enable_force_upload = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] enable_new_services = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] enable_unsupported_driver = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] enforce_multipath_for_image_xfer = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] filter_function = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance_api_insecure = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance_api_ssl_compression = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance_ca_certificates_file = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance_catalog_info = image:glance:publicURL {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance_certfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance_keyfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance_num_retries = 3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance_request_timeout = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] goodness_function = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] graceful_shutdown_timeout = 5 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] group_api_class = cinder.group.api.API {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] host = devstack {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] image_compress_on_upload = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] image_conversion_address_space_limit = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] image_conversion_cpu_limit = 60 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] image_conversion_disable = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] image_upload_use_cinder_backend = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] image_upload_use_internal_tenant = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] image_volume_cache_enabled = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] image_volume_cache_max_count = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] image_volume_cache_max_size_gb = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] init_host_max_objects_retrieval = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] instance_format = [instance: %(uuid)s] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] iscsi_target_flags = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] iscsi_write_cache = on {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] iser_helper = tgtadm {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] iser_ip_address = 192.168.122.106 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] iser_port = 3260 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] log_color = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] log_config_append = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] log_dir = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] log_file = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] log_options = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] log_rotate_interval = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] log_rotate_interval_type = days {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] log_rotation_type = none {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] max_age = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] max_logfile_count = 30 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] max_logfile_size_mb = 200 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] max_over_subscription_ratio = 20.0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] message_reap_interval = 86400 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] message_ttl = 2592000 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] migration_create_volume_timeout_secs = 300 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] monkey_patch = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] monkey_patch_modules = [] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] my_ip = 192.168.122.106 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] no_snapshot_gb_quota = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] num_iser_scan_tries = 3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] num_shell_tries = 3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] num_volume_device_scan_tries = 3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] nvmeof_conn_info_version = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] nvmet_ns_id = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] nvmet_port_id = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] osapi_max_limit = 1000 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] osapi_volume_ext_list = [] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:21 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72367]: INFO cinder.volume.manager [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] osapi_volume_listen_port = 8776 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] osapi_volume_use_ssl = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] osapi_volume_workers = 2 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] per_volume_size_limit = -1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] periodic_fuzzy_delay = 60 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] periodic_interval = 60 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] public_endpoint = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] publish_errors = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] quota_backup_gigabytes = 1000 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] quota_backups = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] quota_gigabytes = 1000 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] quota_groups = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] quota_snapshots = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] quota_volumes = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] rate_limit_burst = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] rate_limit_except_level = CRITICAL {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] rate_limit_interval = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] reinit_driver_count = 3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] replication_device = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] report_discard_supported = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] report_interval = 120 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] reservation_clean_interval = 86400 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] reservation_expire = 86400 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] reserved_image_namespaces = [] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] reserved_percentage = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] rpc_response_timeout = 120 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] run_external_periodic_tasks = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] scst_target_driver = iscsi {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] scst_target_iqn_name = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] service_down_time = 720 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] shell_completion = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] snapshot_name_template = snapshot-%s {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] snapshot_same_host = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] split_loggers = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] state_path = /opt/stack/data/cinder {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] storage_availability_zone = nova {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] storage_protocol = iSCSI {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] syslog_log_facility = LOG_USER {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] target_helper = lioadm {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] target_ip_address = 192.168.122.106 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] target_port = 3260 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] target_protocol = iscsi {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] target_secondary_ip_addresses = [] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] trace_flags = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] transport_url = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] until_refresh = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] use_chap_auth = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] use_default_quota_class = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] use_journal = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:22 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] use_json = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] use_multipath_for_image_xfer = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] use_stderr = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] use_syslog = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] verify_glance_signatures = enabled {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_api_class = cinder.volume.api.API {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_backend_name = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_clear = zero {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_clear_ionice = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_clear_size = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_copy_bps_limit = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_dd_blocksize = 1M {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_name_template = volume-%s {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_service_inithost_offload = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volume_usage_audit_period = month {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] zoning_mode = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_concurrency.disable_process_locking = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.admin_password = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.admin_token = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.admin_user = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.auth_port = 35357 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.auth_protocol = https {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.auth_section = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.auth_type = password {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.auth_uri = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.auth_version = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.cache = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.certfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.identity_uri = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.include_service_catalog = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.insecure = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.interface = public {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.keyfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_password = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcache_username = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.region_name = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.service_type = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.backend = dogpile.cache.null {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.backend_argument = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.backend_expiration_time = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.config_prefix = cache.oslo {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.debug_cache_backend = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.enable_retry_client = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.enable_socket_keepalive = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.enabled = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.enforce_fips_mode = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.expiration_time = 600 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.hashclient_retry_attempts = 2 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.memcache_dead_retry = 300 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.memcache_pool_maxsize = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.memcache_sasl_enabled = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.password = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.proxies = [] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.redis_db = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.redis_server = localhost:6379 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.retry_attempts = 2 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.retry_delay = 0.0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.socket_keepalive_count = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.socket_keepalive_idle = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.socket_keepalive_interval = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.socket_timeout = 1.0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.tls_allowed_ciphers = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.tls_cafile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.tls_certfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.tls_enabled = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.tls_keyfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:22 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cache.username = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] coordination.backend_url = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.asyncio_connection = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.asyncio_slave_connection = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.backend = sqlalchemy {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.connection = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.connection_debug = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.connection_parameters = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.connection_recycle_time = 3600 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.connection_trace = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.db_inc_retry_interval = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.db_max_retries = 20 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.db_max_retry_interval = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.db_retry_interval = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.max_overflow = 50 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.max_pool_size = 5 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.max_retries = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.mysql_wsrep_sync_wait = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.pool_timeout = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.retry_interval = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.slave_connection = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.sqlite_synchronous = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.synchronous_reader = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] database.use_db_reconnect = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler.connection_string = messaging:// {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler.enabled = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler.es_doc_type = notification {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler.es_scroll_size = 10000 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler.es_scroll_time = 2m {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler.filter_error_trace = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler.hmac_keys = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler.sentinel_service_name = mymaster {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler.socket_timeout = 0.1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler.trace_requests = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler.trace_sqlalchemy = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler_jaeger.process_tags = {} {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler_jaeger.service_name_prefix = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] profiler_otlp.service_name_prefix = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_policy.enforce_new_defaults = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: WARNING oslo_config.cfg [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_policy.enforce_scope = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_policy.policy_default_rule = default {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_policy.policy_file = policy.yaml {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] privsep_osbrick.group = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] privsep_osbrick.helper_command = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] privsep_osbrick.user = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cinder_sys_admin.group = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cinder_sys_admin.helper_command = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] cinder_sys_admin.user = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] service_user.auth_section = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] service_user.auth_type = password {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] service_user.cafile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] service_user.certfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] service_user.collect_timing = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] service_user.insecure = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] service_user.keyfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] service_user.send_service_user_token = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] service_user.split_loggers = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] service_user.timeout = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance.auth_section = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance.auth_type = password {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance.certfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance.collect_timing = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance.insecure = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance.keyfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack sudo[72371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance.region_name = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack sudo[72371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance.split_loggers = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] glance.timeout = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.backend_availability_zone = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.chap_password = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.chap_username = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.disk_geometry = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.driver_client_cert = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.driver_client_cert_key = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.driver_data_namespace = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.driver_use_ssl = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.extra_capabilities = {} {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.filter_function = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.goodness_function = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.iscsi_target_flags = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.iscsi_write_cache = on {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.iser_helper = tgtadm {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.iser_port = 3260 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.lvm_share_target = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.lvm_type = auto {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.num_shell_tries = 3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.replication_device = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.report_discard_supported = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.reserved_percentage = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.target_helper = tgtadm {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.target_port = 3260 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.target_protocol = iscsi {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.trace_flags = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.unique_fqdn_network = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.use_chap_auth = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.volume_backend_name = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.volume_clear = zero {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.volume_clear_ionice = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.volume_clear_size = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_reports.file_event_handler = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_reports.log_dir = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.backend_host = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.chap_password = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.chap_username = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.disk_geometry = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.driver_client_cert = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.extra_capabilities = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.filter_function = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.goodness_function = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.iser_helper = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.iser_ip_address = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.iser_port = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.lvm_share_target = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.lvm_type = auto {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.num_shell_tries = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.replication_device = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.report_discard_supported = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.reserved_percentage = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.scst_target_driver = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.storage_protocol = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.target_helper = lioadm {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.target_ip_address = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.target_port = 3260 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.trace_flags = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.use_chap_auth = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.volume_clear = zero {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.volume_clear_size = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] lvmdriver-1.volumes_dir = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.ssl = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_notifications.driver = [] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_notifications.retry = -1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] key_manager.fixed_key = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.barbican_api_version = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.barbican_endpoint = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.barbican_endpoint_type = public {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.barbican_region_name = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.cafile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.certfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.collect_timing = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.insecure = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.keyfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.number_of_retries = 60 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.retry_delay = 1 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.send_service_user_token = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.split_loggers = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.timeout = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.verify_ssl = True {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican.verify_ssl_path = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican_service_user.auth_section = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican_service_user.auth_type = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican_service_user.cafile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican_service_user.certfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican_service_user.collect_timing = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican_service_user.insecure = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican_service_user.keyfile = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican_service_user.split_loggers = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] barbican_service_user.timeout = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vault.approle_role_id = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vault.approle_secret_id = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vault.kv_mountpoint = secret {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vault.kv_path = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vault.kv_version = 2 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vault.namespace = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vault.root_token_id = **** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vault.ssl_ca_crt_file = None {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vault.timeout = 60.0 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vault.use_ssl = False {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:24:22 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] ******************************************************************************** {{(pid=72262) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 09 13:24:22 devstack sudo[72371]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:22 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:22 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:22 devstack sudo[72465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:24:22 devstack sudo[72465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:23 devstack sudo[72465]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:23 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.565s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:23 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:24:23 devstack cinder-volume[72367]: INFO cinder.brick.local_dev.lvm [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 09 13:24:23 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:23 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:23 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:23 devstack sudo[72687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 13:24:23 devstack sudo[72687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:23 devstack sudo[72687]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:23 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.549s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:23 devstack cinder-volume[72367]: DEBUG cinder.brick.local_dev.lvm [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72367) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 09 13:24:23 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:23 devstack sudo[72865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:24:23 devstack sudo[72865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:24 devstack sudo[72865]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:24 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.098s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:24 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:24 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:24 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:25 devstack sudo[73026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:24:25 devstack sudo[73026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:25 devstack sudo[73026]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:25 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:25 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:25 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:25 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:25 devstack sudo[73066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 09 13:24:25 devstack sudo[73066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:25 devstack sudo[73066]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:25 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.468s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:25 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:25 devstack sudo[73069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 13:24:25 devstack sudo[73069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:26 devstack sudo[73069]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:26 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:26 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:26 devstack sudo[73074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 13:24:26 devstack sudo[73074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:26 devstack sudo[73074]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:26 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:26 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:26 devstack sudo[73077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:24:26 devstack sudo[73077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:27 devstack sudo[73077]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:27 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:27 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:27 devstack sudo[73085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:24:27 devstack sudo[73085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:27 devstack sudo[73085]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:27 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:27 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:27 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:27 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:27 devstack sudo[73089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:24:27 devstack sudo[73089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:28 devstack sudo[73089]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:28 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:28 devstack cinder-volume[72367]: INFO cinder.volume.drivers.lvm [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 09 13:24:28 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:28 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:28 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:28 devstack sudo[73149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:24:28 devstack sudo[73149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:28 devstack sudo[73149]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:28 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.505s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:28 devstack cinder-volume[72367]: DEBUG cinder.volume.drivers.lvm [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Updating volume stats {{(pid=72367) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 13:24:28 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:28 devstack sudo[73227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 13:24:28 devstack sudo[73227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:29 devstack sudo[73227]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:29 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:29 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:29 devstack sudo[73355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:24:29 devstack sudo[73355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:29 devstack sudo[73355]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:29 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:29 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:29 devstack sudo[73358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:24:29 devstack sudo[73358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:30 devstack sudo[73358]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:30 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:30 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:30 devstack sudo[73362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:24:30 devstack sudo[73362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:30 devstack sudo[73362]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:30 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.490s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:30 devstack cinder-volume[72367]: INFO cinder.volume.driver [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Driver hasn't implemented _init_vendor_properties() Apr 09 13:24:30 devstack cinder-volume[72367]: DEBUG cinder.volume.driver [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72367) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 09 13:24:30 devstack cinder-volume[72367]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72367) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:24:30 devstack cinder-volume[72367]: DEBUG dbcounter [-] [72367] Writer thread running {{(pid=72367) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 13:24:30 devstack cinder-volume[72367]: DEBUG cinder.db.sqlalchemy.api [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Building query based on filter {{(pid=72367) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 09 13:24:30 devstack cinder-volume[72367]: DEBUG cinder.image.image_utils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72367) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 09 13:24:30 devstack cinder-volume[72367]: INFO cinder.keymgr.migration [None req-18344448-9cce-4d78-b38d-6d38d3516154 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 09 13:24:30 devstack cinder-volume[72367]: DEBUG cinder.volume.drivers.lvm [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Updating volume stats {{(pid=72367) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 13:24:30 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:30 devstack sudo[73367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 13:24:30 devstack sudo[73367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:31 devstack sudo[73367]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:31 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.515s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:31 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:31 devstack sudo[73374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:24:31 devstack sudo[73374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:31 devstack cinder-volume[72262]: DEBUG dbcounter [-] [72262] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72262) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:24:31 devstack sudo[73374]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:31 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.539s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:31 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:31 devstack sudo[73379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:24:31 devstack sudo[73379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:32 devstack sudo[73379]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:32 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:32 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:32 devstack sudo[73384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:24:32 devstack sudo[73384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:32 devstack sudo[73384]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:32 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.507s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:32 devstack cinder-volume[72367]: DEBUG cinder.manager [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Notifying Schedulers of capabilities ... {{(pid=72367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:24:33 devstack cinder-volume[72367]: INFO cinder.volume.manager [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Driver initialization completed successfully. Apr 09 13:24:33 devstack cinder-volume[72367]: INFO cinder.manager [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Initiating service 2 cleanup Apr 09 13:24:33 devstack cinder-volume[72367]: INFO cinder.manager [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Service 2 cleanup completed. Apr 09 13:24:33 devstack cinder-volume[72367]: DEBUG cinder.service [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Creating RPC server for service cinder-volume {{(pid=72367) start /opt/stack/cinder/cinder/service.py:231}} Apr 09 13:24:33 devstack cinder-volume[72367]: DEBUG cinder.service [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72367) start /opt/stack/cinder/cinder/service.py:237}} Apr 09 13:24:33 devstack cinder-volume[72367]: INFO cinder.volume.manager [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 09 13:24:33 devstack cinder-volume[72367]: DEBUG cinder.volume.drivers.lvm [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Updating volume stats {{(pid=72367) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 13:24:33 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:33 devstack sudo[73387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 13:24:33 devstack sudo[73387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:33 devstack sudo[73387]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:33 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:33 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:33 devstack sudo[73447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:24:33 devstack sudo[73447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:34 devstack sudo[73447]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:34 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:34 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:34 devstack sudo[73450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:24:34 devstack sudo[73450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:34 devstack sudo[73450]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:34 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.477s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:34 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:24:34 devstack sudo[73453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:24:34 devstack sudo[73453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:24:34 devstack sudo[73453]: pam_unix(sudo:session): session closed for user root Apr 09 13:24:34 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:24:35 devstack cinder-volume[72367]: INFO cinder.volume.manager [None req-f1e24b20-3d07-428b-b658-2a5a7c9ef223 None None] Driver post RPC initialization completed successfully. Apr 09 13:24:44 devstack cinder-volume[72367]: DEBUG dbcounter [-] [72367] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72367) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:24:45 devstack cinder-volume[72367]: DEBUG dbcounter [-] [72367] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=72367) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:25:50 devstack cinder-volume[72367]: DEBUG oslo_service.periodic_task [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72367) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:25:50 devstack cinder-volume[72367]: DEBUG cinder.volume.drivers.lvm [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Updating volume stats {{(pid=72367) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 13:25:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:25:50 devstack sudo[78481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 13:25:50 devstack sudo[78481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:25:50 devstack sudo[78481]: pam_unix(sudo:session): session closed for user root Apr 09 13:25:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:25:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:25:50 devstack sudo[78496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:25:50 devstack sudo[78496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:25:50 devstack sudo[78496]: pam_unix(sudo:session): session closed for user root Apr 09 13:25:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:25:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:25:50 devstack sudo[78499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:25:50 devstack sudo[78499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:25:51 devstack sudo[78499]: pam_unix(sudo:session): session closed for user root Apr 09 13:25:51 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:25:51 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:25:51 devstack sudo[78507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:25:51 devstack sudo[78507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:25:51 devstack sudo[78507]: pam_unix(sudo:session): session closed for user root Apr 09 13:25:51 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:25:51 devstack cinder-volume[72367]: DEBUG cinder.manager [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Notifying Schedulers of capabilities ... {{(pid=72367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:26:45 devstack cinder-volume[72367]: DEBUG dbcounter [-] [72367] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72367) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:26:50 devstack cinder-volume[72367]: DEBUG oslo_service.periodic_task [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72367) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:26:50 devstack cinder-volume[72367]: DEBUG cinder.volume.drivers.lvm [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Updating volume stats {{(pid=72367) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 13:26:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:26:50 devstack sudo[80150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 13:26:50 devstack sudo[80150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:26:50 devstack sudo[80150]: pam_unix(sudo:session): session closed for user root Apr 09 13:26:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:26:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:26:50 devstack sudo[80196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:26:50 devstack sudo[80196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:26:50 devstack sudo[80196]: pam_unix(sudo:session): session closed for user root Apr 09 13:26:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:26:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:26:50 devstack sudo[80222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:26:50 devstack sudo[80222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:26:51 devstack sudo[80222]: pam_unix(sudo:session): session closed for user root Apr 09 13:26:51 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:26:51 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:26:51 devstack sudo[80254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:26:51 devstack sudo[80254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:26:51 devstack sudo[80254]: pam_unix(sudo:session): session closed for user root Apr 09 13:26:51 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.516s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:26:51 devstack cinder-volume[72367]: DEBUG cinder.manager [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Notifying Schedulers of capabilities ... {{(pid=72367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:27:50 devstack cinder-volume[72367]: DEBUG oslo_service.periodic_task [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72367) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:27:50 devstack cinder-volume[72367]: DEBUG cinder.volume.drivers.lvm [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Updating volume stats {{(pid=72367) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 09 13:27:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:27:50 devstack sudo[81448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 09 13:27:50 devstack sudo[81448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:27:50 devstack sudo[81448]: pam_unix(sudo:session): session closed for user root Apr 09 13:27:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:27:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:27:50 devstack sudo[81463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:27:50 devstack sudo[81463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:27:50 devstack sudo[81463]: pam_unix(sudo:session): session closed for user root Apr 09 13:27:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:27:50 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:27:50 devstack sudo[81468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 09 13:27:50 devstack sudo[81468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:27:51 devstack sudo[81468]: pam_unix(sudo:session): session closed for user root Apr 09 13:27:51 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:27:51 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:27:51 devstack sudo[81472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 09 13:27:51 devstack sudo[81472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:27:51 devstack sudo[81472]: pam_unix(sudo:session): session closed for user root Apr 09 13:27:51 devstack cinder-volume[72367]: DEBUG oslo_concurrency.processutils [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72367) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:27:51 devstack cinder-volume[72367]: DEBUG cinder.manager [None req-9312a2c0-3e9c-49b4-b780-ab60398a5296 None None] Notifying Schedulers of capabilities ... {{(pid=72367) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:28:05 devstack cinder-volume[72262]: INFO oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Caught SIGTERM, stopping children Apr 09 13:28:05 devstack cinder-volume[72262]: DEBUG oslo_concurrency.lockutils [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Acquiring lock "singleton_lock" {{(pid=72262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 13:28:05 devstack cinder-volume[72262]: DEBUG oslo_concurrency.lockutils [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Acquired lock "singleton_lock" {{(pid=72262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 13:28:05 devstack cinder-volume[72262]: DEBUG oslo_concurrency.lockutils [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Releasing lock "singleton_lock" {{(pid=72262) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 13:28:05 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Stop services. {{(pid=72262) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 09 13:28:05 devstack cinder-volume[72262]: DEBUG oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Killing children. {{(pid=72262) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 09 13:28:05 devstack cinder-volume[72262]: INFO oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Waiting on 1 children to exit Apr 09 13:28:08 devstack cinder-volume[72367]: DEBUG oslo_concurrency.lockutils [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Acquiring lock "singleton_lock" {{(pid=72367) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 13:28:08 devstack cinder-volume[72367]: DEBUG oslo_concurrency.lockutils [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Acquired lock "singleton_lock" {{(pid=72367) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 13:28:08 devstack cinder-volume[72367]: DEBUG oslo_concurrency.lockutils [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Releasing lock "singleton_lock" {{(pid=72367) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 13:28:08 devstack cinder-volume[72367]: WARNING amqp [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 13:28:08 devstack cinder-volume[72367]: WARNING amqp [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 13:28:08 devstack cinder-volume[72262]: INFO oslo_service.backend._eventlet.service [None req-d98e5a2e-aaff-4e06-a1f6-e32b06971b20 None None] Child 72367 exited with status 0 Apr 09 13:28:08 devstack cinder-volume[81854]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 09 13:28:08 devstack cinder-volume[81854]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 13:28:08 devstack cinder-volume[81854]: we strongly recommend against using it for new projects. Apr 09 13:28:08 devstack cinder-volume[81854]: If you are already using Eventlet, we recommend migrating to a different Apr 09 13:28:08 devstack cinder-volume[81854]: framework. For more detail see Apr 09 13:28:08 devstack cinder-volume[81854]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 13:28:08 devstack cinder-volume[81854]: import eventlet # noqa Apr 09 13:28:10 devstack cinder-volume[81854]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 13:28:10 devstack cinder-volume[81854]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 13:28:10 devstack cinder-volume[81854]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 13:28:10 devstack cinder-volume[81854]: INFO dbcounter [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Registered counter for database cinder Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_db.sqlalchemy.engines [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81854) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG dbcounter [-] [81854] Writer thread running {{(pid=81854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 13:28:11 devstack cinder-volume[81854]: INFO cinder.rpc [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 09 13:28:11 devstack cinder-volume[81854]: INFO cinder.rpc [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_db.sqlalchemy.engines [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81854) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:28:11 devstack cinder-volume[81854]: INFO cinder.volume.manager [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Determined volume DB was empty at startup. Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG cinder.volume.manager [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81854) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 09 13:28:11 devstack cinder-volume[81854]: INFO cinder.volume.manager [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 09 13:28:11 devstack cinder-volume[81854]: WARNING stevedore.named [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 13:28:11 devstack cinder-volume[81854]: WARNING castellan.key_manager [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 13:28:11 devstack cinder-volume[81854]: WARNING cinder.keymgr.conf_key_mgr [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 13:28:11 devstack cinder-volume[81854]: INFO cinder.volume.manager [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_db.sqlalchemy.engines [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81854) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:28:11 devstack cinder-volume[81854]: INFO oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Starting 1 workers Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Started child 81971 {{(pid=81854) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Full set of CONF: {{(pid=81854) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] ******************************************************************************** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Configuration options gathered from: {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 09 13:28:11 devstack cinder-volume[81971]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] ================================================================================ {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] allow_availability_zone_fallback = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] allow_compression_on_image_upload = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] allowed_direct_url_schemes = [] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] api_rate_limit = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] auth_strategy = keystone {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_availability_zone = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_host = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_name = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_stats_polling_interval = 60 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backup_api_class = cinder.backup.api.API {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backup_name_template = backup-%s {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backup_use_same_host = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backup_use_temp_snapshot = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] chap_password = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] chap_username = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cinder_internal_tenant_project_id = 9eae7f264dc245d2bc1ba918ea81fb8d {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cinder_internal_tenant_user_id = 5ab1d62b5ae345e58dc262fd793c8f63 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cluster = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] compression_format = gzip {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] compute_api_class = cinder.compute.nova.API {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] config_dir = [] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] config_source = [] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] control_exchange = openstack {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] debug = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] default_availability_zone = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] default_group_type = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] default_volume_type = QuobyteHD {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] disk_geometry = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] driver_client_cert = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] driver_client_cert_key = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] driver_data_namespace = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] driver_ssl_cert_path = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] driver_ssl_cert_verify = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] driver_use_ssl = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] enable_new_services = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] enable_unsupported_driver = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] enabled_backends = ['QuobyteHD'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] enforce_multipath_for_image_xfer = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] filter_function = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance_api_insecure = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance_api_ssl_compression = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance_ca_certificates_file = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance_catalog_info = image:glance:publicURL {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance_certfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance_keyfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance_num_retries = 3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance_request_timeout = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] goodness_function = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] graceful_shutdown_timeout = 5 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] group_api_class = cinder.group.api.API {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] host = devstack {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] image_compress_on_upload = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] image_conversion_address_space_limit = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] image_conversion_cpu_limit = 60 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81971) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] image_conversion_disable = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] image_upload_use_cinder_backend = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] image_upload_use_internal_tenant = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] image_volume_cache_enabled = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] image_volume_cache_max_count = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] image_volume_cache_max_size_gb = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] init_host_max_objects_retrieval = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] instance_format = [instance: %(uuid)s] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] iscsi_target_flags = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] iscsi_write_cache = on {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] iser_helper = tgtadm {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] iser_ip_address = 192.168.122.106 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] iser_port = 3260 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] log_color = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] log_config_append = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] log_dir = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] log_file = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] log_options = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] log_rotate_interval = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] log_rotate_interval_type = days {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] log_rotation_type = none {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] max_age = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] max_logfile_count = 30 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] max_logfile_size_mb = 200 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] max_over_subscription_ratio = 20.0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] message_reap_interval = 86400 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] message_ttl = 2592000 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] migration_create_volume_timeout_secs = 300 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] monkey_patch = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] monkey_patch_modules = [] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] my_ip = 192.168.122.106 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] no_snapshot_gb_quota = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] num_iser_scan_tries = 3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] num_shell_tries = 3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] num_volume_device_scan_tries = 3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] nvmeof_conn_info_version = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] nvmet_ns_id = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] nvmet_port_id = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] osapi_max_limit = 1000 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] osapi_volume_ext_list = [] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] osapi_volume_listen_port = 8776 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] osapi_volume_use_ssl = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] osapi_volume_workers = 2 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] per_volume_size_limit = -1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] periodic_fuzzy_delay = 60 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] periodic_interval = 60 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] public_endpoint = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] publish_errors = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] quota_backup_gigabytes = 1000 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] quota_backups = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] quota_gigabytes = 1000 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] quota_groups = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] quota_snapshots = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] quota_volumes = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] rate_limit_burst = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] rate_limit_except_level = CRITICAL {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] rate_limit_interval = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] reinit_driver_count = 3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] replication_device = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] report_discard_supported = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] report_interval = 120 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] reservation_clean_interval = 86400 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] reservation_expire = 86400 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] reserved_image_namespaces = [] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] reserved_percentage = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] rpc_response_timeout = 120 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] run_external_periodic_tasks = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] scst_target_driver = iscsi {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] scst_target_iqn_name = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] service_down_time = 720 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] shell_completion = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] snapshot_name_template = snapshot-%s {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] split_loggers = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] state_path = /opt/stack/data/cinder {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] storage_availability_zone = nova {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] storage_protocol = iSCSI {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] syslog_log_facility = LOG_USER {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] target_helper = lioadm {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] target_ip_address = 192.168.122.106 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] target_port = 3260 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] target_protocol = iscsi {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] target_secondary_ip_addresses = [] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] trace_flags = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] transport_url = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] until_refresh = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] use_chap_auth = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] use_default_quota_class = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] use_journal = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] use_json = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] use_multipath_for_image_xfer = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] use_stderr = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] use_syslog = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] verify_glance_signatures = enabled {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_api_class = cinder.volume.api.API {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81971) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 09 13:28:11 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.quobyte [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 09 13:28:11 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.quobyte [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_backend_name = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_clear = zero {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_clear_ionice = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Running cmd (subprocess): mount.quobyte {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_clear_size = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_copy_bps_limit = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_dd_blocksize = 1M {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_name_template = volume-%s {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_service_inithost_offload = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volume_usage_audit_period = month {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] zoning_mode = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_concurrency.disable_process_locking = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.admin_password = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.admin_token = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.admin_user = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.auth_port = 35357 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.auth_protocol = https {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.auth_section = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.auth_type = password {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.auth_uri = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.auth_version = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.cache = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.certfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.identity_uri = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.include_service_catalog = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.insecure = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.interface = public {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.keyfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_password = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcache_username = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.region_name = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.service_type = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.backend = dogpile.cache.null {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.backend_argument = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.backend_expiration_time = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.config_prefix = cache.oslo {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.debug_cache_backend = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.enable_retry_client = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.enable_socket_keepalive = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.enabled = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.enforce_fips_mode = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.expiration_time = 600 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.hashclient_retry_attempts = 2 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.memcache_dead_retry = 300 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.memcache_pool_maxsize = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.memcache_sasl_enabled = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.password = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.proxies = [] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.redis_db = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.redis_server = localhost:6379 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.retry_attempts = 2 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.retry_delay = 0.0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.socket_keepalive_count = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.socket_keepalive_idle = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.socket_keepalive_interval = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.socket_timeout = 1.0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.tls_allowed_ciphers = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.tls_cafile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.tls_certfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.tls_enabled = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.tls_keyfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cache.username = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] coordination.backend_url = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.asyncio_connection = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.asyncio_slave_connection = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.backend = sqlalchemy {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.connection = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.connection_debug = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.connection_parameters = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.connection_recycle_time = 3600 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.connection_trace = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.db_inc_retry_interval = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.db_max_retries = 20 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.db_max_retry_interval = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.db_retry_interval = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.max_overflow = 50 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.max_pool_size = 5 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.max_retries = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.mysql_wsrep_sync_wait = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.pool_timeout = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.retry_interval = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.slave_connection = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.sqlite_synchronous = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.synchronous_reader = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] database.use_db_reconnect = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler.connection_string = messaging:// {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler.enabled = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler.es_doc_type = notification {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler.es_scroll_size = 10000 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler.es_scroll_time = 2m {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler.filter_error_trace = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler.hmac_keys = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler.sentinel_service_name = mymaster {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler.socket_timeout = 0.1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler.trace_requests = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler.trace_sqlalchemy = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler_jaeger.process_tags = {} {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler_jaeger.service_name_prefix = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] profiler_otlp.service_name_prefix = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_policy.enforce_new_defaults = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: WARNING oslo_config.cfg [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_policy.enforce_scope = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_policy.policy_default_rule = default {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_policy.policy_file = policy.yaml {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack quobyte-client[81972]: Reading configuration file: /etc/quobyte/client.cfg Apr 09 13:28:11 devstack quobyte-client[81972]: Invalid parameters found, error: missing mount point. Apr 09 13:28:11 devstack quobyte-client[81972]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 09 13:28:11 devstack quobyte-client[81972]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] privsep_osbrick.group = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] privsep_osbrick.helper_command = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] privsep_osbrick.user = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cinder_sys_admin.group = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cinder_sys_admin.helper_command = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] cinder_sys_admin.user = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] service_user.auth_section = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] service_user.auth_type = password {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] service_user.cafile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] service_user.certfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] service_user.collect_timing = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] service_user.insecure = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] service_user.keyfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] service_user.send_service_user_token = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] service_user.split_loggers = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] service_user.timeout = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance.auth_section = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance.auth_type = password {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance.certfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance.collect_timing = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:28:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance.insecure = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance.keyfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81971]: INFO cinder.volume.drivers.quobyte [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 ... Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance.region_name = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de -c /etc/quobyte/client-cinder.cfg {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance.split_loggers = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] glance.timeout = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.backend_availability_zone = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.chap_password = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.chap_username = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.disk_geometry = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.driver_client_cert = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.driver_client_cert_key = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.driver_data_namespace = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.driver_use_ssl = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.extra_capabilities = {} {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.filter_function = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.goodness_function = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.iscsi_target_flags = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.iscsi_write_cache = on {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.iser_helper = tgtadm {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.iser_port = 3260 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nas_host = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nas_login = admin {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nas_mount_options = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nas_password = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nas_private_key = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nas_share_path = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack sudo[81973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de -c /etc/quobyte/client-cinder.cfg Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack sudo[81973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.num_shell_tries = 3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.quobyte_volume_url = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.replication_device = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.report_discard_supported = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.reserved_percentage = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.target_helper = tgtadm {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.target_port = 3260 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.target_protocol = iscsi {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.trace_flags = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.unique_fqdn_network = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.use_chap_auth = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.volume_backend_name = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.volume_clear = zero {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.volume_clear_ionice = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.volume_clear_size = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_reports.file_event_handler = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_reports.log_dir = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.backend_availability_zone = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.backend_host = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.chap_password = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.chap_username = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.chiscsi_conf = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.disk_geometry = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.driver_client_cert = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.driver_data_namespace = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.driver_use_ssl = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.extra_capabilities = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.filter_function = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.goodness_function = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.iser_helper = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.iser_ip_address = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.iser_port = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.iser_target_prefix = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nas_host = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nas_login = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nas_mount_options = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nas_password = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nas_private_key = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nas_share_path = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nas_ssh_port = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.num_shell_tries = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.nvmet_port_id = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.replication_device = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.report_discard_supported = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.reserved_percentage = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.scst_target_driver = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.storage_protocol = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.target_helper = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.target_ip_address = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.target_port = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.target_prefix = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.target_protocol = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.trace_flags = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.use_chap_auth = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.volume_clear = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.volume_clear_size = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] QuobyteHD.volumes_dir = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.ssl = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_notifications.driver = [] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_notifications.retry = -1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] key_manager.fixed_key = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.barbican_api_version = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.barbican_endpoint = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.barbican_endpoint_type = public {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.barbican_region_name = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.cafile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.certfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.collect_timing = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.insecure = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.keyfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.number_of_retries = 60 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.retry_delay = 1 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.send_service_user_token = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.split_loggers = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.timeout = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.verify_ssl = True {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican.verify_ssl_path = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican_service_user.auth_section = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican_service_user.auth_type = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican_service_user.cafile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican_service_user.certfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican_service_user.collect_timing = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican_service_user.insecure = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican_service_user.keyfile = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican_service_user.split_loggers = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] barbican_service_user.timeout = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vault.approle_role_id = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vault.approle_secret_id = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vault.kv_mountpoint = secret {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vault.kv_path = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vault.kv_version = 2 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vault.namespace = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vault.root_token_id = **** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vault.ssl_ca_crt_file = None {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vault.timeout = 60.0 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vault.use_ssl = False {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:11 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] ******************************************************************************** {{(pid=81854) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 09 13:28:12 devstack sudo[81973]: pam_unix(sudo:session): session closed for user root Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.504s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:28:12 devstack cinder-volume[81971]: INFO cinder.volume.drivers.quobyte [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 succeeded Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.512s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:28:12 devstack sudo[82042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:28:12 devstack sudo[82042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:28:12 devstack sudo[82042]: pam_unix(sudo:session): session closed for user root Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.397s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:28:12 devstack cinder-volume[81971]: INFO cinder.volume.driver [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Driver hasn't implemented _init_vendor_properties() Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG cinder.volume.driver [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6929969787598, 'free_capacity_gb': 1775.6929969787598, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81971) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_db.sqlalchemy.engines [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writer thread running {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG cinder.db.sqlalchemy.api [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Building query based on filter {{(pid=81971) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81971) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 09 13:28:12 devstack cinder-volume[81971]: INFO cinder.keymgr.migration [None req-39ed9c6f-b9b5-47c0-8042-327bb81e560a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:28:12 devstack sudo[82045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:28:12 devstack sudo[82045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:28:12 devstack sudo[82045]: pam_unix(sudo:session): session closed for user root Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.411s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:28:12 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Driver initialization completed successfully. Apr 09 13:28:12 devstack cinder-volume[81971]: INFO cinder.manager [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Initiating service 3 cleanup Apr 09 13:28:12 devstack cinder-volume[81971]: INFO cinder.manager [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Service 3 cleanup completed. Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG cinder.service [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Creating RPC server for service cinder-volume {{(pid=81971) start /opt/stack/cinder/cinder/service.py:231}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG cinder.service [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81971) start /opt/stack/cinder/cinder/service.py:237}} Apr 09 13:28:12 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:28:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:28:13 devstack sudo[82050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:28:13 devstack sudo[82050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:28:13 devstack sudo[82050]: pam_unix(sudo:session): session closed for user root Apr 09 13:28:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.458s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:28:13 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2ee4fece-018b-4cb1-9251-ef2f38e44825 None None] Driver post RPC initialization completed successfully. Apr 09 13:28:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f25ad352-3883-4473-a2a6-bb84410368f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:28:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f25ad352-3883-4473-a2a6-bb84410368f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:28:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f25ad352-3883-4473-a2a6-bb84410368f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:28:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f25ad352-3883-4473-a2a6-bb84410368f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:28:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f25ad352-3883-4473-a2a6-bb84410368f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:28:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f25ad352-3883-4473-a2a6-bb84410368f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:28:16 devstack sudo[82116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:28:16 devstack sudo[82116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:28:16 devstack sudo[82116]: pam_unix(sudo:session): session closed for user root Apr 09 13:28:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f25ad352-3883-4473-a2a6-bb84410368f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.427s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:28:16 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-f25ad352-3883-4473-a2a6-bb84410368f0 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:28:19 devstack cinder-volume[81854]: INFO oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Caught SIGTERM, stopping children Apr 09 13:28:19 devstack cinder-volume[81854]: DEBUG oslo_concurrency.lockutils [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Acquiring lock "singleton_lock" {{(pid=81854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 13:28:19 devstack cinder-volume[81854]: DEBUG oslo_concurrency.lockutils [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Acquired lock "singleton_lock" {{(pid=81854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 13:28:19 devstack cinder-volume[81854]: DEBUG oslo_concurrency.lockutils [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Releasing lock "singleton_lock" {{(pid=81854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 13:28:19 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Stop services. {{(pid=81854) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 09 13:28:19 devstack cinder-volume[81854]: DEBUG oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Killing children. {{(pid=81854) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 09 13:28:19 devstack cinder-volume[81854]: INFO oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Waiting on 1 children to exit Apr 09 13:28:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Acquiring lock "singleton_lock" {{(pid=81971) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 13:28:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Acquired lock "singleton_lock" {{(pid=81971) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 13:28:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Releasing lock "singleton_lock" {{(pid=81971) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 13:28:21 devstack cinder-volume[81971]: WARNING amqp [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 13:28:21 devstack cinder-volume[81971]: WARNING amqp [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 09 13:28:21 devstack cinder-volume[81854]: INFO oslo_service.backend._eventlet.service [None req-b42b33c2-b77f-4426-ab19-14b863b926e8 None None] Child 81971 exited with status 0 Apr 09 13:28:21 devstack cinder-volume[82201]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 09 13:28:21 devstack cinder-volume[82201]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 13:28:21 devstack cinder-volume[82201]: we strongly recommend against using it for new projects. Apr 09 13:28:21 devstack cinder-volume[82201]: If you are already using Eventlet, we recommend migrating to a different Apr 09 13:28:21 devstack cinder-volume[82201]: framework. For more detail see Apr 09 13:28:21 devstack cinder-volume[82201]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 13:28:21 devstack cinder-volume[82201]: import eventlet # noqa Apr 09 13:28:23 devstack cinder-volume[82201]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82201) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 09 13:28:23 devstack cinder-volume[82201]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82201) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 09 13:28:23 devstack cinder-volume[82201]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82201) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 09 13:28:23 devstack cinder-volume[82201]: INFO dbcounter [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Registered counter for database cinder Apr 09 13:28:23 devstack cinder-volume[82201]: DEBUG oslo_db.sqlalchemy.engines [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82201) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG dbcounter [-] [82201] Writer thread running {{(pid=82201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 13:28:24 devstack cinder-volume[82201]: INFO cinder.rpc [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 09 13:28:24 devstack cinder-volume[82201]: INFO cinder.rpc [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_db.sqlalchemy.engines [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82201) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:28:24 devstack cinder-volume[82201]: INFO cinder.volume.manager [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Determined volume DB was empty at startup. Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG cinder.volume.manager [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82201) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 09 13:28:24 devstack cinder-volume[82201]: WARNING stevedore.named [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 09 13:28:24 devstack cinder-volume[82201]: WARNING castellan.key_manager [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 13:28:24 devstack cinder-volume[82201]: WARNING cinder.keymgr.conf_key_mgr [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 09 13:28:24 devstack cinder-volume[82201]: INFO cinder.volume.manager [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_db.sqlalchemy.engines [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82201) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:28:24 devstack cinder-volume[82201]: INFO oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Starting 1 workers Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Started child 82346 {{(pid=82201) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Full set of CONF: {{(pid=82201) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] ******************************************************************************** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Configuration options gathered from: {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] ================================================================================ {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] allow_availability_zone_fallback = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] allow_compression_on_image_upload = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] allowed_direct_url_schemes = [] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] api_rate_limit = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] auth_strategy = keystone {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_availability_zone = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_host = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_name = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_stats_polling_interval = 60 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backup_api_class = cinder.backup.api.API {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backup_name_template = backup-%s {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backup_use_same_host = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backup_use_temp_snapshot = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] chap_password = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] chap_username = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cinder_internal_tenant_project_id = 9eae7f264dc245d2bc1ba918ea81fb8d {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cinder_internal_tenant_user_id = 5ab1d62b5ae345e58dc262fd793c8f63 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cluster = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] compression_format = gzip {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] compute_api_class = cinder.compute.nova.API {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] config_dir = [] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] config_source = [] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] control_exchange = openstack {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] debug = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] default_availability_zone = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] default_group_type = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] default_volume_type = QuobyteHD {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] disk_geometry = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] driver_client_cert = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] driver_client_cert_key = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] driver_data_namespace = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] driver_ssl_cert_path = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] driver_ssl_cert_verify = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] driver_use_ssl = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] enable_new_services = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82346]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] enable_unsupported_driver = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] enabled_backends = ['QuobyteHD'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] enforce_multipath_for_image_xfer = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] filter_function = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance_api_insecure = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance_api_servers = ['http://192.168.122.106/image'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance_api_ssl_compression = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance_ca_certificates_file = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance_catalog_info = image:glance:publicURL {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance_certfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance_keyfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance_num_retries = 3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance_request_timeout = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] goodness_function = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] graceful_shutdown_timeout = 5 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] group_api_class = cinder.group.api.API {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] host = devstack {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] image_compress_on_upload = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] image_conversion_address_space_limit = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] image_conversion_cpu_limit = 60 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] image_conversion_disable = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] image_upload_use_cinder_backend = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] image_upload_use_internal_tenant = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] image_volume_cache_enabled = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] image_volume_cache_max_count = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] image_volume_cache_max_size_gb = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] init_host_max_objects_retrieval = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] instance_format = [instance: %(uuid)s] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] iscsi_target_flags = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] iscsi_write_cache = on {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] iser_helper = tgtadm {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] iser_ip_address = 192.168.122.106 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] iser_port = 3260 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] log_color = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] log_config_append = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] log_dir = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] log_file = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] log_options = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] log_rotate_interval = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] log_rotate_interval_type = days {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] log_rotation_type = none {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] max_age = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] max_logfile_count = 30 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] max_logfile_size_mb = 200 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] max_over_subscription_ratio = 20.0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] message_reap_interval = 86400 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] message_ttl = 2592000 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] migration_create_volume_timeout_secs = 300 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] monkey_patch = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] monkey_patch_modules = [] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] my_ip = 192.168.122.106 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] no_snapshot_gb_quota = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] num_iser_scan_tries = 3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] num_shell_tries = 3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] num_volume_device_scan_tries = 3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] nvmeof_conn_info_version = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] nvmet_ns_id = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] nvmet_port_id = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] osapi_max_limit = 1000 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] osapi_volume_ext_list = [] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] osapi_volume_listen_port = 8776 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] osapi_volume_use_ssl = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] osapi_volume_workers = 2 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] per_volume_size_limit = -1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] periodic_fuzzy_delay = 60 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] periodic_interval = 60 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] public_endpoint = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] publish_errors = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] quota_backup_gigabytes = 1000 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] quota_backups = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] quota_gigabytes = 1000 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] quota_groups = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] quota_snapshots = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] quota_volumes = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] rate_limit_burst = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] rate_limit_except_level = CRITICAL {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] rate_limit_interval = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] reinit_driver_count = 3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] replication_device = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] report_discard_supported = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] report_interval = 120 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] reservation_clean_interval = 86400 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] reservation_expire = 86400 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] reserved_image_namespaces = [] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] reserved_percentage = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] rpc_response_timeout = 120 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] run_external_periodic_tasks = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] scst_target_driver = iscsi {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] scst_target_iqn_name = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] service_down_time = 720 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] shell_completion = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] snapshot_name_template = snapshot-%s {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] split_loggers = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] state_path = /opt/stack/data/cinder {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] storage_availability_zone = nova {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] storage_protocol = iSCSI {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] syslog_log_facility = LOG_USER {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] target_helper = lioadm {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] target_ip_address = 192.168.122.106 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] target_port = 3260 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] target_protocol = iscsi {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] target_secondary_ip_addresses = [] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] trace_flags = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] transport_url = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] until_refresh = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] use_chap_auth = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] use_default_quota_class = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] use_journal = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] use_json = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] use_multipath_for_image_xfer = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] use_stderr = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] use_syslog = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] verify_glance_signatures = enabled {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_api_class = cinder.volume.api.API {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_backend_name = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_clear = zero {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_clear_ionice = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_clear_size = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_copy_bps_limit = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_dd_blocksize = 1M {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_name_template = volume-%s {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_service_inithost_offload = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volume_usage_audit_period = month {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] zoning_mode = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_concurrency.disable_process_locking = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.admin_password = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.admin_token = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.admin_user = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.auth_port = 35357 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.auth_protocol = https {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.auth_section = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.auth_type = password {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.auth_uri = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.auth_version = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.cache = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.certfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82346) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.identity_uri = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.include_service_catalog = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.insecure = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.interface = public {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.keyfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_password = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcache_username = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.region_name = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.service_type = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.106/identity {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.backend = dogpile.cache.null {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.backend_argument = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.backend_expiration_time = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.config_prefix = cache.oslo {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.debug_cache_backend = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.enable_retry_client = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.enable_socket_keepalive = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.enabled = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.enforce_fips_mode = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.expiration_time = 600 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.hashclient_retry_attempts = 2 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.memcache_dead_retry = 300 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.memcache_pool_maxsize = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.memcache_sasl_enabled = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.password = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.proxies = [] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.redis_db = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.redis_server = localhost:6379 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.retry_attempts = 2 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.retry_delay = 0.0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.socket_keepalive_count = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.socket_keepalive_idle = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.socket_keepalive_interval = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.socket_timeout = 1.0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.tls_allowed_ciphers = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.tls_cafile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.tls_certfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.tls_enabled = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.tls_keyfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cache.username = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] coordination.backend_url = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.asyncio_connection = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.asyncio_slave_connection = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.backend = sqlalchemy {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.connection = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.connection_debug = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.connection_parameters = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.connection_recycle_time = 3600 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.connection_trace = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.db_inc_retry_interval = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.db_max_retries = 20 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.db_max_retry_interval = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.db_retry_interval = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.max_overflow = 50 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.max_pool_size = 5 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.max_retries = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.mysql_wsrep_sync_wait = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.pool_timeout = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.retry_interval = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.slave_connection = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.sqlite_synchronous = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.synchronous_reader = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] database.use_db_reconnect = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler.connection_string = messaging:// {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler.enabled = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler.es_doc_type = notification {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler.es_scroll_size = 10000 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler.es_scroll_time = 2m {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler.filter_error_trace = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler.hmac_keys = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler.sentinel_service_name = mymaster {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler.socket_timeout = 0.1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler.trace_requests = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler.trace_sqlalchemy = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler_jaeger.process_tags = {} {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler_jaeger.service_name_prefix = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] profiler_otlp.service_name_prefix = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_policy.enforce_new_defaults = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: WARNING oslo_config.cfg [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_policy.enforce_scope = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_policy.policy_default_rule = default {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_policy.policy_file = policy.yaml {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] privsep_osbrick.group = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] privsep_osbrick.helper_command = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack sudo[82389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] privsep_osbrick.user = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cinder_sys_admin.group = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cinder_sys_admin.helper_command = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack sudo[82389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] cinder_sys_admin.user = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] service_user.auth_section = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] service_user.auth_type = password {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] service_user.cafile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] service_user.certfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] service_user.collect_timing = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] service_user.insecure = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] service_user.keyfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] service_user.send_service_user_token = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] service_user.split_loggers = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] service_user.timeout = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance.auth_section = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance.auth_type = password {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance.certfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance.collect_timing = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance.insecure = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance.keyfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance.region_name = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance.split_loggers = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] glance.timeout = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.backend_availability_zone = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.chap_password = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.chap_username = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.disk_geometry = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.driver_client_cert = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.driver_client_cert_key = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.driver_data_namespace = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.driver_use_ssl = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.extra_capabilities = {} {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.filter_function = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.goodness_function = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.iscsi_target_flags = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.iscsi_write_cache = on {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.iser_helper = tgtadm {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.iser_ip_address = 192.168.122.106 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.iser_port = 3260 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nas_host = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nas_login = admin {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nas_mount_options = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nas_password = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nas_private_key = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nas_share_path = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.num_shell_tries = 3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82346) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 09 13:28:24 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.quobyte [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 09 13:28:24 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.quobyte [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 09 13:28:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Running cmd (subprocess): mount.quobyte {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.quobyte_volume_url = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.replication_device = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.report_discard_supported = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.reserved_percentage = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.target_helper = tgtadm {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.target_ip_address = 192.168.122.106 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.target_port = 3260 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.target_protocol = iscsi {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.trace_flags = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.unique_fqdn_network = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.use_chap_auth = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.volume_backend_name = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.volume_clear = zero {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.volume_clear_ionice = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.volume_clear_size = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_reports.file_event_handler = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_reports.log_dir = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.backend_availability_zone = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.backend_host = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.chap_password = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.chap_username = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.chiscsi_conf = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.disk_geometry = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.driver_client_cert = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.driver_data_namespace = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.driver_use_ssl = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.extra_capabilities = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.filter_function = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.goodness_function = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.iser_helper = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.iser_ip_address = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.iser_port = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.iser_target_prefix = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nas_host = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nas_login = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nas_mount_options = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nas_password = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nas_private_key = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nas_share_path = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nas_ssh_port = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.num_shell_tries = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.nvmet_port_id = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:24 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.replication_device = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.report_discard_supported = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.reserved_percentage = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.scst_target_driver = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.storage_protocol = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.target_helper = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.target_ip_address = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.target_port = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.target_prefix = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.target_protocol = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.trace_flags = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.use_chap_auth = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.volume_clear = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.volume_clear_size = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] QuobyteHD.volumes_dir = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.ssl = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_notifications.driver = [] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_notifications.retry = -1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] key_manager.fixed_key = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.barbican_api_version = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.barbican_endpoint = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.barbican_endpoint_type = public {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.barbican_region_name = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.cafile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.certfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.collect_timing = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.insecure = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.keyfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.number_of_retries = 60 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.retry_delay = 1 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.send_service_user_token = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.split_loggers = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.timeout = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.verify_ssl = True {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican.verify_ssl_path = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican_service_user.auth_section = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican_service_user.auth_type = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican_service_user.cafile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican_service_user.certfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican_service_user.collect_timing = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican_service_user.insecure = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican_service_user.keyfile = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican_service_user.split_loggers = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] barbican_service_user.timeout = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vault.approle_role_id = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vault.approle_secret_id = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vault.kv_mountpoint = secret {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vault.kv_path = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vault.kv_version = 2 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vault.namespace = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vault.root_token_id = **** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vault.ssl_ca_crt_file = None {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vault.timeout = 60.0 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vault.use_ssl = False {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 09 13:28:25 devstack cinder-volume[82201]: DEBUG oslo_service.backend._eventlet.service [None req-dfa62525-3881-4a79-aff1-c82b36ff5746 None None] ******************************************************************************** {{(pid=82201) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] CMD "mount.quobyte" returned: 1 in 0.171s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:28:25 devstack sudo[82389]: pam_unix(sudo:session): session closed for user root Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.539s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:28:25 devstack cinder-volume[82346]: INFO cinder.volume.driver [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Driver hasn't implemented _init_vendor_properties() Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.volume.driver [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.690357208252, 'free_capacity_gb': 1775.690357208252, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82346) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_db.sqlalchemy.engines [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82346) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writer thread running {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.db.sqlalchemy.api [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Building query based on filter {{(pid=82346) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82346) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:28:25 devstack cinder-volume[82346]: INFO cinder.keymgr.migration [None req-7d92b383-a0c9-4934-9a44-1b9b8ca5487a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 09 13:28:25 devstack sudo[82431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:28:25 devstack sudo[82431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:28:25 devstack sudo[82431]: pam_unix(sudo:session): session closed for user root Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.408s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:28:25 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Driver initialization completed successfully. Apr 09 13:28:25 devstack cinder-volume[82346]: INFO cinder.manager [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Initiating service 3 cleanup Apr 09 13:28:25 devstack cinder-volume[82346]: INFO cinder.manager [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Service 3 cleanup completed. Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.service [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Creating RPC server for service cinder-volume {{(pid=82346) start /opt/stack/cinder/cinder/service.py:231}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.service [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82346) start /opt/stack/cinder/cinder/service.py:237}} Apr 09 13:28:25 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:28:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:28:25 devstack sudo[82448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:28:25 devstack sudo[82448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:28:26 devstack sudo[82448]: pam_unix(sudo:session): session closed for user root Apr 09 13:28:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.402s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:28:26 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-23666ff5-310a-44d4-9695-38ac0366eff9 None None] Driver post RPC initialization completed successfully. Apr 09 13:28:34 devstack cinder-volume[82201]: DEBUG dbcounter [-] [82201] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82201) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:28:35 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:28:36 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=3 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Flow 'volume_create_manager' (b9e92cad-2332-46a5-b641-3df746e8600b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2860ab9-c2f2-4936-bb47-2e15c0d16e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2860ab9-c2f2-4936-bb47-2e15c0d16e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-314479186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cae51cbe8013458b86cce5e81b52454b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:29:32Z,use_quota=True,user_id='ea1d4fb75bfa4e49a4cc4556b2f4b603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bb6aea-ad80-4ba5-aaef-938e7524a336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bb6aea-ad80-4ba5-aaef-938e7524a336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d907667-e5ef-417c-b090-88160434ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d907667-e5ef-417c-b090-88160434ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b', 'volume_name': 'volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc29b286-bde6-4dd7-9bd7-7411cde9dabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc29b286-bde6-4dd7-9bd7-7411cde9dabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae938792-a074-45cd-a9d9-0811d31f8c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:31 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Volume eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b', 'volume_size': 1} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-314479186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cae51cbe8013458b86cce5e81b52454b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:29:32Z,use_quota=True,user_id='ea1d4fb75bfa4e49a4cc4556b2f4b603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Creating volume eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:29:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:29:31 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:29:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:29:32 devstack sudo[82946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b 1073741824 Apr 09 13:29:32 devstack sudo[82946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:29:33 devstack cinder-volume[82346]: DEBUG oslo_service.periodic_task [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82346) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:29:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:29:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:29:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:29:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:29:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:29:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:29:33 devstack sudo[83275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:29:33 devstack sudo[83275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:29:33 devstack sudo[82946]: pam_unix(sudo:session): session closed for user root Apr 09 13:29:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b 1073741824" returned: 0 in 1.863s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:29:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:29:34 devstack sudo[83291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b Apr 09 13:29:34 devstack sudo[83291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:29:34 devstack sudo[83275]: pam_unix(sudo:session): session closed for user root Apr 09 13:29:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 1.368s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:29:34 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:29:35 devstack sudo[83291]: pam_unix(sudo:session): session closed for user root Apr 09 13:29:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b" returned: 0 in 1.470s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:29:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] <== create_volume: return (3448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:29:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.451s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:29:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae938792-a074-45cd-a9d9-0811d31f8c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530dd6bd-6f62-4b94-8fc6-443028bc9805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:35 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Volume volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b (eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b): created successfully Apr 09 13:29:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530dd6bd-6f62-4b94-8fc6-443028bc9805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Flow 'volume_create_manager' (b9e92cad-2332-46a5-b641-3df746e8600b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:29:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-01c0ed09-b7f8-4d73-a0df-3d9fd3223f54 tempest-VolumesAdminNegativeTest-1100723490 None] Created volume successfully. Apr 09 13:29:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Acquiring lock "cinder-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:29:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Lock "cinder-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:29:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Acquiring lock "cinder-quobyte-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:29:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Lock "cinder-quobyte-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b" acquired by "delete_volume" :: waited 0.022s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:29:37 devstack cinder-volume[82346]: INFO oslo.privsep.daemon [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplb4lfna6/privsep.sock'] Apr 09 13:29:37 devstack sudo[83314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplb4lfna6/privsep.sock Apr 09 13:29:37 devstack sudo[83314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: Apr 09 13:29:38 devstack cinder-volume[82346]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 09 13:29:39 devstack sudo[83314]: pam_unix(sudo:session): session closed for user root Apr 09 13:29:39 devstack cinder-volume[82346]: INFO oslo.privsep.daemon [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Spawned new privsep daemon via rootwrap Apr 09 13:29:39 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Accepted privsep connection to /tmp/tmplb4lfna6/privsep.sock {{(pid=82346) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 09 13:29:39 devstack cinder-volume[82346]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 09 13:29:39 devstack cinder-volume[82346]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 09 13:29:39 devstack cinder-volume[82346]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 09 13:29:39 devstack cinder-volume[82346]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83319 Apr 09 13:29:39 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbca752-6576-44fc-a36c-5e6d099cc868]: (2,) {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:29:39 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfbd4ae-16c6-42ab-8815-702245e24df6]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:29:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:29:39 devstack sudo[83321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b Apr 09 13:29:39 devstack sudo[83321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:29:40 devstack sudo[83321]: pam_unix(sudo:session): session closed for user root Apr 09 13:29:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b" returned: 0 in 1.085s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:29:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:29:40 devstack sudo[83326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b Apr 09 13:29:40 devstack sudo[83326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:29:41 devstack sudo[83326]: pam_unix(sudo:session): session closed for user root Apr 09 13:29:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b" returned: 0 in 1.099s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:29:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Lock "cinder-quobyte-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b" released by "delete_volume" :: held 3.928s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:29:41 devstack cinder-volume[82346]: WARNING cinder.quota [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:29:41 devstack cinder-volume[82346]: WARNING cinder.quota [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:29:41 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Created reservations ['ac3d4279-8acf-4ebf-9a8e-418809924fb9', '01952580-8024-428e-a981-4c207dde98a0', '9d12e0f9-63e8-4bfc-a771-7ed86e0c35db', 'd97370f3-6445-445e-8101-349ba51af8de'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:29:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:29:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:29:41 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:29:41 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:29:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:29:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:29:41 devstack sudo[83329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:29:41 devstack sudo[83329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:29:42 devstack sudo[83329]: pam_unix(sudo:session): session closed for user root Apr 09 13:29:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.928s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:29:42 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:29:42 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Deleted volume successfully. Apr 09 13:29:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fb1fb874-072a-4b0a-84f3-8110dbb1c0bd tempest-VolumesAdminNegativeTest-1100723490 None] Lock "cinder-eeba7fe9-656d-4e70-aebb-dd0a03cd1d8b-delete_volume" released by "delete_volume" :: held 5.288s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Flow 'volume_create_manager' (b0927579-0835-4521-a321-ab3d90dc80aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa4ab7d-36d1-4c1d-8de6-ce5a1470455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa4ab7d-36d1-4c1d-8de6-ce5a1470455d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:29:49Z,deleted=False,deleted_at=None,display_description='',display_name='74633ec6-5394-4bae-9c1a-b983ac221ddc-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab57e57d-4cd6-4a81-9c25-a1e093f72b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f1f8c4fa334bd0b82e03832912e6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:29:50Z,use_quota=True,user_id='5758bd0c11fc40ac8af8c94b13553de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65883be7-d7ae-46b7-8cef-df98bafa1727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65883be7-d7ae-46b7-8cef-df98bafa1727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95372216-c91d-441e-8446-cc5166649afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95372216-c91d-441e-8446-cc5166649afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab57e57d-4cd6-4a81-9c25-a1e093f72b5b', 'volume_name': 'volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37e5a8e-83b0-4f95-9243-176eba6f3f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37e5a8e-83b0-4f95-9243-176eba6f3f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff9dc18-38d6-44bb-b8f9-9ed4e6931573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:49 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Volume ab57e57d-4cd6-4a81-9c25-a1e093f72b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b', 'volume_size': 1} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:29:49Z,deleted=False,deleted_at=None,display_description='',display_name='74633ec6-5394-4bae-9c1a-b983ac221ddc-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab57e57d-4cd6-4a81-9c25-a1e093f72b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f1f8c4fa334bd0b82e03832912e6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:29:50Z,use_quota=True,user_id='5758bd0c11fc40ac8af8c94b13553de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Creating volume ab57e57d-4cd6-4a81-9c25-a1e093f72b5b {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:29:49 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:29:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:29:50 devstack sudo[83425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b 1073741824 Apr 09 13:29:50 devstack sudo[83425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:29:52 devstack sudo[83425]: pam_unix(sudo:session): session closed for user root Apr 09 13:29:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b 1073741824" returned: 0 in 2.281s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:29:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:29:52 devstack sudo[83474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b Apr 09 13:29:52 devstack sudo[83474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:29:53 devstack sudo[83474]: pam_unix(sudo:session): session closed for user root Apr 09 13:29:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b" returned: 0 in 0.916s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:29:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] <== create_volume: return (3251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:29:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.259s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:29:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff9dc18-38d6-44bb-b8f9-9ed4e6931573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0687144-7ad8-4494-8f94-8f1212126561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:29:53 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Volume volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b (ab57e57d-4cd6-4a81-9c25-a1e093f72b5b): created successfully Apr 09 13:29:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0687144-7ad8-4494-8f94-8f1212126561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:29:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Flow 'volume_create_manager' (b0927579-0835-4521-a321-ab3d90dc80aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:29:53 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-9417dff6-0fc5-4cfa-9504-d1c7784f541d tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Created volume successfully. Apr 09 13:29:58 devstack cinder-volume[82346]: WARNING py.warnings [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-e914eff8-d7a0-4b8d-a557-f1ce134769df tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 09 13:29:58 devstack cinder-volume[82346]: .first() Apr 09 13:29:58 devstack cinder-volume[82346]: Apr 09 13:29:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-e914eff8-d7a0-4b8d-a557-f1ce134769df tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:29:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-e914eff8-d7a0-4b8d-a557-f1ce134769df tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:29:59 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a158cf85-f584-4533-b1de-e310551d7bea]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:29:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-e914eff8-d7a0-4b8d-a557-f1ce134769df tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:29:59 devstack sudo[83565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b Apr 09 13:29:59 devstack sudo[83565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:00 devstack sudo[83565]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-e914eff8-d7a0-4b8d-a557-f1ce134769df tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b" returned: 0 in 1.287s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-e914eff8-d7a0-4b8d-a557-f1ce134769df tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.321s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-e914eff8-d7a0-4b8d-a557-f1ce134769df tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0', 'name': 'volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4698f354-8e85-4447-852c-0947e7ceba04', 'enforce_multipath': True} {{(pid=82346) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 09 13:30:00 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-6882e3c1-c9e9-4f5b-8b31-55a70314f76f req-e914eff8-d7a0-4b8d-a557-f1ce134769df tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] attachment_update completed successfully. Apr 09 13:30:01 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Flow 'volume_create_manager' (f03f1da6-978b-497a-b0d2-cadb12afe849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8501b595-8014-421a-93d8-07090c3c15e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8501b595-8014-421a-93d8-07090c3c15e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2136773597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ebd812e12a4cf3ab45ef500c71fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:02Z,use_quota=True,user_id='c1092a94eeae415fa09993e592459345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5b80bb-2333-4494-98a4-290fc3f00537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5b80bb-2333-4494-98a4-290fc3f00537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb44b12a-592e-49d9-a947-79d214c2351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb44b12a-592e-49d9-a947-79d214c2351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f', 'volume_name': 'volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6d5284-e8b6-41f2-8a1e-1f4722cdefe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6d5284-e8b6-41f2-8a1e-1f4722cdefe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15221cfa-12f9-42e3-94d0-d647555d5859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:02 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Volume 0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f', 'volume_size': 1} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2136773597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ebd812e12a4cf3ab45ef500c71fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:02Z,use_quota=True,user_id='c1092a94eeae415fa09993e592459345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Creating volume 0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:30:02 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:30:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:02 devstack sudo[83589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f 1073741824 Apr 09 13:30:02 devstack sudo[83589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:03 devstack sudo[83589]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f 1073741824" returned: 0 in 0.994s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:03 devstack sudo[83596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f Apr 09 13:30:03 devstack sudo[83596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:03 devstack sudo[83596]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f" returned: 0 in 0.724s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:30:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15221cfa-12f9-42e3-94d0-d647555d5859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fa0186-f660-41b1-be55-628b751d6be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:03 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Volume volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f (0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f): created successfully Apr 09 13:30:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fa0186-f660-41b1-be55-628b751d6be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Flow 'volume_create_manager' (f03f1da6-978b-497a-b0d2-cadb12afe849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:03 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d3ae6be5-46ba-4180-b767-478070e72945 tempest-ServersNegativeTestJSON-2038521466 None] Created volume successfully. Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Flow 'volume_create_manager' (036686ae-444b-4eac-bbc4-0828247e4d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77bc09e-7e84-4026-a103-3e1e10386116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77bc09e-7e84-4026-a103-3e1e10386116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-586951375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd002d7-61f0-4dd5-b754-7fe837f6ec2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ebd812e12a4cf3ab45ef500c71fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:06Z,use_quota=True,user_id='c1092a94eeae415fa09993e592459345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae42db1-62de-4d02-884b-89c846da28de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae42db1-62de-4d02-884b-89c846da28de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79688ac-9edf-4a33-bcd6-940f19de8248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79688ac-9edf-4a33-bcd6-940f19de8248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd002d7-61f0-4dd5-b754-7fe837f6ec2b', 'volume_name': 'volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdce934-e5ef-4690-a3a4-27b33c4189ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdce934-e5ef-4690-a3a4-27b33c4189ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bca67a-5228-4b5c-b052-e95f3df2de6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:05 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Volume 1dd002d7-61f0-4dd5-b754-7fe837f6ec2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b', 'volume_size': 1} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-586951375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd002d7-61f0-4dd5-b754-7fe837f6ec2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34ebd812e12a4cf3ab45ef500c71fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:06Z,use_quota=True,user_id='c1092a94eeae415fa09993e592459345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Creating volume 1dd002d7-61f0-4dd5-b754-7fe837f6ec2b {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:30:05 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:30:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:05 devstack sudo[83678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b 1073741824 Apr 09 13:30:05 devstack sudo[83678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:06 devstack sudo[83678]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b 1073741824" returned: 0 in 1.100s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:06 devstack sudo[84050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b Apr 09 13:30:06 devstack sudo[84050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:08 devstack sudo[84050]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b" returned: 0 in 1.551s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] <== create_volume: return (2702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:30:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.706s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bca67a-5228-4b5c-b052-e95f3df2de6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69b78bc-7043-406f-9b8d-06c97af7756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:08 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Volume volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b (1dd002d7-61f0-4dd5-b754-7fe837f6ec2b): created successfully Apr 09 13:30:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69b78bc-7043-406f-9b8d-06c97af7756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Flow 'volume_create_manager' (036686ae-444b-4eac-bbc4-0828247e4d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:08 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ead31504-29af-4d7b-ac22-5b7063ce9dd0 tempest-ServersNegativeTestJSON-2038521466 None] Created volume successfully. Apr 09 13:30:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Acquiring lock "cinder-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Lock "cinder-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Acquiring lock "cinder-quobyte-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Lock "cinder-quobyte-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b" acquired by "delete_volume" :: waited 0.033s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:10 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4a2f14-d4cc-4c2a-b0af-37fff8ddd887]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:10 devstack sudo[84062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b Apr 09 13:30:10 devstack sudo[84062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:10 devstack sudo[84062]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b" returned: 0 in 0.673s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:10 devstack sudo[84067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b Apr 09 13:30:10 devstack sudo[84067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:11 devstack sudo[84067]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b" returned: 0 in 0.646s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Lock "cinder-quobyte-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b" released by "delete_volume" :: held 1.403s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Created reservations ['6e472d66-1066-4227-876f-024ae5f1ea96', '279fdfa0-6903-4fb6-bc00-7db1cba28bfe', 'a5f325b7-e1c4-4146-9a0b-ed8fe407bd3c', 'b73bfa7e-03d7-42ad-aa1b-e4abafc89dba'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:11 devstack sudo[84071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:30:11 devstack sudo[84071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Flow 'volume_create_manager' (fbe61da1-1232-49c9-8f51-b4e438b4fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202a9406-e7cc-4821-913d-a6fd611b196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202a9406-e7cc-4821-913d-a6fd611b196f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-429855664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8318cca-f68d-4954-9a02-eba2136045da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0b6d253e0f484f88e73635a1583ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:12Z,use_quota=True,user_id='5d111b8c81234123b9a6b9458a635975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e980e924-2e62-476a-aac7-4ad0068b0877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e980e924-2e62-476a-aac7-4ad0068b0877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092cba71-5d2f-475a-99e1-3a255d86eec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092cba71-5d2f-475a-99e1-3a255d86eec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8318cca-f68d-4954-9a02-eba2136045da', 'volume_name': 'volume-a8318cca-f68d-4954-9a02-eba2136045da', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1f84dd-a069-4d0f-b199-477ea3538ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1f84dd-a069-4d0f-b199-477ea3538ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a72a471-6274-4d2d-addb-089a141ea7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:11 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Volume a8318cca-f68d-4954-9a02-eba2136045da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8318cca-f68d-4954-9a02-eba2136045da', 'volume_size': 1} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-429855664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8318cca-f68d-4954-9a02-eba2136045da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0b6d253e0f484f88e73635a1583ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:12Z,use_quota=True,user_id='5d111b8c81234123b9a6b9458a635975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Creating volume a8318cca-f68d-4954-9a02-eba2136045da {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:30:11 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:30:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:11 devstack sudo[84073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da 1073741824 Apr 09 13:30:11 devstack sudo[84073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Acquiring lock "cinder-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Lock "cinder-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:12 devstack sudo[84071]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.900s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:12 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:30:12 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Deleted volume successfully. Apr 09 13:30:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Acquiring lock "cinder-quobyte-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Lock "cinder-quobyte-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f" acquired by "delete_volume" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-327e26a0-3bcf-4bf9-b5ad-84678cef23af tempest-ServersNegativeTestJSON-2038521466 None] Lock "cinder-1dd002d7-61f0-4dd5-b754-7fe837f6ec2b-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:12 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c57d6d-cbf4-4ed3-8b24-b1f4b6dab651]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:12 devstack sudo[84077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f Apr 09 13:30:12 devstack sudo[84077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:12 devstack sudo[84073]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da 1073741824" returned: 0 in 0.862s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:12 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da Apr 09 13:30:12 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:13 devstack sudo[84077]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f" returned: 0 in 0.677s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:13 devstack sudo[84087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f Apr 09 13:30:13 devstack sudo[84087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:13 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da" returned: 0 in 0.544s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a72a471-6274-4d2d-addb-089a141ea7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8318cca-f68d-4954-9a02-eba2136045da', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d8320a-1e8a-43c3-a5c0-b29b9c48fb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:13 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Volume volume-a8318cca-f68d-4954-9a02-eba2136045da (a8318cca-f68d-4954-9a02-eba2136045da): created successfully Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d8320a-1e8a-43c3-a5c0-b29b9c48fb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Flow 'volume_create_manager' (fbe61da1-1232-49c9-8f51-b4e438b4fc30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:13 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-582e490e-69b5-4fdf-a5ac-e989d41014e5 tempest-DeleteServersTestJSON-781441953 None] Created volume successfully. Apr 09 13:30:13 devstack sudo[84087]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f" returned: 0 in 0.587s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Lock "cinder-quobyte-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f" released by "delete_volume" :: held 1.296s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Created reservations ['980cd267-a053-4155-8f36-d1cf161fdc91', '627a247e-f9c3-42ca-8907-3d04c8d9d142', 'a783b331-b83b-406b-8614-4cb04694a847', '9db52acc-d9a0-4d48-816c-9edf813ff0dc'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:13 devstack sudo[84091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:30:13 devstack sudo[84091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:14 devstack sudo[84091]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.529s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:14 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:30:14 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Deleted volume successfully. Apr 09 13:30:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb1587fa-429d-457a-b121-e9a09885930d tempest-ServersNegativeTestJSON-2038521466 None] Lock "cinder-0c3c2a46-ab6f-4755-b4b4-c0024cbb6e3f-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-367b0d72-1e20-476b-ac86-65d411156dde req-ed24d468-613a-4d27-ade1-621e3558fb47 tempest-DeleteServersTestJSON-781441953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-367b0d72-1e20-476b-ac86-65d411156dde req-ed24d468-613a-4d27-ade1-621e3558fb47 tempest-DeleteServersTestJSON-781441953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:17 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b903c01-43be-4897-b741-620170534fa9]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-367b0d72-1e20-476b-ac86-65d411156dde req-ed24d468-613a-4d27-ade1-621e3558fb47 tempest-DeleteServersTestJSON-781441953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:17 devstack sudo[84192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da Apr 09 13:30:17 devstack sudo[84192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:18 devstack sudo[84192]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-367b0d72-1e20-476b-ac86-65d411156dde req-ed24d468-613a-4d27-ade1-621e3558fb47 tempest-DeleteServersTestJSON-781441953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da" returned: 0 in 0.800s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-367b0d72-1e20-476b-ac86-65d411156dde req-ed24d468-613a-4d27-ade1-621e3558fb47 tempest-DeleteServersTestJSON-781441953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.838s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-367b0d72-1e20-476b-ac86-65d411156dde req-ed24d468-613a-4d27-ade1-621e3558fb47 tempest-DeleteServersTestJSON-781441953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0', 'name': 'volume-a8318cca-f68d-4954-9a02-eba2136045da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff2d1749-b8d8-40c6-bded-f5d5ffa5c3dd', 'enforce_multipath': True} {{(pid=82346) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 09 13:30:18 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-367b0d72-1e20-476b-ac86-65d411156dde req-ed24d468-613a-4d27-ade1-621e3558fb47 tempest-DeleteServersTestJSON-781441953 None] attachment_update completed successfully. Apr 09 13:30:20 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-94f93685-34a5-4bc1-a5e2-cad1d8a8721b tempest-GroupsTest-1346184842 None] Group tempest-Group1-830300304: creating Apr 09 13:30:20 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-94f93685-34a5-4bc1-a5e2-cad1d8a8721b tempest-GroupsTest-1346184842 None] Group tempest-Group1-830300304: created successfully Apr 09 13:30:20 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-94f93685-34a5-4bc1-a5e2-cad1d8a8721b tempest-GroupsTest-1346184842 None] Create group completed successfully. Apr 09 13:30:22 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-26d57821-acfe-4e3f-9bb5-6290c765fafc tempest-GroupsTest-1346184842 None] Group tempest-Group2-1634742321: creating Apr 09 13:30:22 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-26d57821-acfe-4e3f-9bb5-6290c765fafc tempest-GroupsTest-1346184842 None] Group tempest-Group2-1634742321: created successfully Apr 09 13:30:22 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-26d57821-acfe-4e3f-9bb5-6290c765fafc tempest-GroupsTest-1346184842 None] Create group completed successfully. Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Flow 'volume_create_manager' (339f472a-b45f-4844-bf69-251a4d46af75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09d2c0f-ccb2-4cbc-b3de-66ecf5a938e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09d2c0f-ccb2-4cbc-b3de-66ecf5a938e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-626923278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c5fb55c-4b43-4e8b-a0ae-662e42586471,host='devstack@QuobyteHD#QuobyteHD',id=65250024-72e5-4657-8dd8-ea4293a3b298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56d05933ae4322a0a7d8aee09516c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:23Z,use_quota=True,user_id='512cc5decb5e46f1bf4c2703c698e053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbcad7ab-02a8-4272-a31e-744d245a627e),volume_type_id=fbcad7ab-02a8-4272-a31e-744d245a627e)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34a3804-2b17-4aaf-8ec6-059cc5f43584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34a3804-2b17-4aaf-8ec6-059cc5f43584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2df453e-b2db-433e-aa9e-9b7fd0d6b6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2df453e-b2db-433e-aa9e-9b7fd0d6b6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65250024-72e5-4657-8dd8-ea4293a3b298', 'volume_name': 'volume-65250024-72e5-4657-8dd8-ea4293a3b298', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d895146-2b85-4bc3-8e77-25ed6f9404d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d895146-2b85-4bc3-8e77-25ed6f9404d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8593a7-c1a8-4757-b745-fd02b09f6a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:23 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Volume 65250024-72e5-4657-8dd8-ea4293a3b298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65250024-72e5-4657-8dd8-ea4293a3b298', 'volume_size': 1} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c5fb55c-4b43-4e8b-a0ae-662e42586471,created_at=2026-04-09T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-626923278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c5fb55c-4b43-4e8b-a0ae-662e42586471,host='devstack@QuobyteHD#QuobyteHD',id=65250024-72e5-4657-8dd8-ea4293a3b298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56d05933ae4322a0a7d8aee09516c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:23Z,use_quota=True,user_id='512cc5decb5e46f1bf4c2703c698e053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbcad7ab-02a8-4272-a31e-744d245a627e),volume_type_id=fbcad7ab-02a8-4272-a31e-744d245a627e)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Creating volume 65250024-72e5-4657-8dd8-ea4293a3b298 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:30:23 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:30:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:23 devstack sudo[84257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298 1073741824 Apr 09 13:30:23 devstack sudo[84257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:24 devstack sudo[84257]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298 1073741824" returned: 0 in 1.094s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:24 devstack sudo[84290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298 Apr 09 13:30:24 devstack sudo[84290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:25 devstack sudo[84290]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298" returned: 0 in 0.585s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:30:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed8593a7-c1a8-4757-b745-fd02b09f6a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65250024-72e5-4657-8dd8-ea4293a3b298', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92331ab-cec1-4271-9c01-8f84fd01d77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:25 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Volume volume-65250024-72e5-4657-8dd8-ea4293a3b298 (65250024-72e5-4657-8dd8-ea4293a3b298): created successfully Apr 09 13:30:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92331ab-cec1-4271-9c01-8f84fd01d77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Flow 'volume_create_manager' (339f472a-b45f-4844-bf69-251a4d46af75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:25 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-83b8ac52-e7b4-48b7-8da9-49a411a88319 tempest-GroupsTest-1346184842 None] Created volume successfully. Apr 09 13:30:26 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=40,cinder:UPDATE=43,cinder:DELETE=5,cinder:INSERT=6 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:30:26 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=43,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=4 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:30:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Acquiring lock "cinder-quobyte-65250024-72e5-4657-8dd8-ea4293a3b298" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Lock "cinder-quobyte-65250024-72e5-4657-8dd8-ea4293a3b298" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:26 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a762dc-1c3c-4390-bc94-c8cffb00fd8c]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:26 devstack sudo[84304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298 Apr 09 13:30:26 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:26 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-96191ee2-96d2-4f0c-ac93-16e712f2800e req-2af380fd-cfc6-4475-aeb3-4e9d2b3ede44 tempest-DeleteServersTestJSON-781441953 None] Terminate volume connection completed successfully. Apr 09 13:30:26 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-96191ee2-96d2-4f0c-ac93-16e712f2800e req-2af380fd-cfc6-4475-aeb3-4e9d2b3ede44 tempest-DeleteServersTestJSON-781441953 None] Deleting attachment ff2d1749-b8d8-40c6-bded-f5d5ffa5c3dd. {{(pid=82346) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 09 13:30:27 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298" returned: 0 in 0.739s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:27 devstack sudo[84346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298 Apr 09 13:30:27 devstack sudo[84346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:28 devstack sudo[84346]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-65250024-72e5-4657-8dd8-ea4293a3b298" returned: 0 in 0.700s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Lock "cinder-quobyte-65250024-72e5-4657-8dd8-ea4293a3b298" released by "delete_volume" :: held 1.477s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Created reservations ['217712af-47d9-449c-a5fc-f84366466198'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:28 devstack cinder-volume[82346]: WARNING cinder.quota [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-648366723 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-648366723, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:30:28 devstack cinder-volume[82346]: WARNING cinder.quota [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-648366723 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-648366723, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Created reservations ['a861dae2-0ba3-4def-a570-b3fc048d4e09', '56788e9c-b381-4242-b4be-ec89cbc99ca8', 'daa0af94-1226-4e6f-bc17-6e93c6aac099', '300dc4c0-0224-42ee-a9a4-74b0f29634b4'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:28 devstack sudo[84355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:30:28 devstack sudo[84355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:28 devstack sudo[84355]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.539s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:30:28 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-12f4c0b9-63d6-40d2-82ff-aba6abcb8187 tempest-GroupsTest-1346184842 None] Delete group completed successfully. Apr 09 13:30:28 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-3fa7e9ff-a9d4-40f8-8bca-3118c83ad567 tempest-GroupsTest-1346184842 None] Created reservations ['89793d72-d16a-4e01-927c-00eb1202faf8'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3fa7e9ff-a9d4-40f8-8bca-3118c83ad567 tempest-GroupsTest-1346184842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3fa7e9ff-a9d4-40f8-8bca-3118c83ad567 tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3fa7e9ff-a9d4-40f8-8bca-3118c83ad567 tempest-GroupsTest-1346184842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3fa7e9ff-a9d4-40f8-8bca-3118c83ad567 tempest-GroupsTest-1346184842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3fa7e9ff-a9d4-40f8-8bca-3118c83ad567 tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3fa7e9ff-a9d4-40f8-8bca-3118c83ad567 tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:29 devstack sudo[84365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:30:29 devstack sudo[84365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:29 devstack sudo[84365]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3fa7e9ff-a9d4-40f8-8bca-3118c83ad567 tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.553s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:29 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-3fa7e9ff-a9d4-40f8-8bca-3118c83ad567 tempest-GroupsTest-1346184842 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:30:29 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3fa7e9ff-a9d4-40f8-8bca-3118c83ad567 tempest-GroupsTest-1346184842 None] Delete group completed successfully. Apr 09 13:30:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c52db877-6f65-4146-a37d-4b397ea7b15c tempest-BackendsCapabilitiesAdminTestsJSON-1177064106 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.690357208252, 'free_capacity_gb': 1775.690357208252, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82346) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 09 13:30:30 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b23fb72e-7b00-4fab-a0ab-29ccb3819e8b tempest-GroupsTest-1346184842 None] Group tempest-GroupsTest-Group-1232863831: creating Apr 09 13:30:30 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b23fb72e-7b00-4fab-a0ab-29ccb3819e8b tempest-GroupsTest-1346184842 None] Group tempest-GroupsTest-Group-1232863831: created successfully Apr 09 13:30:30 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b23fb72e-7b00-4fab-a0ab-29ccb3819e8b tempest-GroupsTest-1346184842 None] Create group completed successfully. Apr 09 13:30:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Acquiring lock "cinder-a8318cca-f68d-4954-9a02-eba2136045da-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Lock "cinder-a8318cca-f68d-4954-9a02-eba2136045da-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Acquiring lock "cinder-quobyte-a8318cca-f68d-4954-9a02-eba2136045da" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Lock "cinder-quobyte-a8318cca-f68d-4954-9a02-eba2136045da" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:30 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f33004b-fe45-46b0-9f58-da8c3a0c9615]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:30 devstack sudo[84375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da Apr 09 13:30:30 devstack sudo[84375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4455507c-a670-4a51-b901-7802e7d01ec4 tempest-BackendsCapabilitiesAdminTestsJSON-1177064106 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.690357208252, 'free_capacity_gb': 1775.690357208252, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82346) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 09 13:30:31 devstack sudo[84375]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da" returned: 0 in 0.559s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:31 devstack sudo[84381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da Apr 09 13:30:31 devstack sudo[84381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Flow 'volume_create_manager' (8cfcf10a-d279-4823-a1a8-e7d39566794a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132e180d-d778-4e22-8dd3-c1bc08aa6ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:31 devstack sudo[84381]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132e180d-d778-4e22-8dd3-c1bc08aa6ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-481803412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7edad66a-6293-4663-80af-c919a0d46aa2,host='devstack@QuobyteHD#QuobyteHD',id=fcc69d39-8c45-4455-b421-be622a9348df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56d05933ae4322a0a7d8aee09516c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:32Z,use_quota=True,user_id='512cc5decb5e46f1bf4c2703c698e053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d9b456-5386-43d5-8530-9fea6ad2303f),volume_type_id=34d9b456-5386-43d5-8530-9fea6ad2303f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f992ddc5-a11c-4a6a-ae50-2c9656d7618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f992ddc5-a11c-4a6a-ae50-2c9656d7618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc245b26-f907-4122-9ba8-26b906d98074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc245b26-f907-4122-9ba8-26b906d98074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc69d39-8c45-4455-b421-be622a9348df', 'volume_name': 'volume-fcc69d39-8c45-4455-b421-be622a9348df', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0302ced-d97c-4ec2-849e-313e4a674c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0302ced-d97c-4ec2-849e-313e4a674c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfab0b9-4a91-4385-bb06-2548e777deea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:31 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Volume fcc69d39-8c45-4455-b421-be622a9348df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc69d39-8c45-4455-b421-be622a9348df', 'volume_size': 1} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7edad66a-6293-4663-80af-c919a0d46aa2,created_at=2026-04-09T11:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-481803412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7edad66a-6293-4663-80af-c919a0d46aa2,host='devstack@QuobyteHD#QuobyteHD',id=fcc69d39-8c45-4455-b421-be622a9348df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56d05933ae4322a0a7d8aee09516c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:32Z,use_quota=True,user_id='512cc5decb5e46f1bf4c2703c698e053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d9b456-5386-43d5-8530-9fea6ad2303f),volume_type_id=34d9b456-5386-43d5-8530-9fea6ad2303f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Creating volume fcc69d39-8c45-4455-b421-be622a9348df {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:30:31 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:30:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a8318cca-f68d-4954-9a02-eba2136045da" returned: 0 in 0.609s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Lock "cinder-quobyte-a8318cca-f68d-4954-9a02-eba2136045da" released by "delete_volume" :: held 1.194s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:32 devstack sudo[84384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df 1073741824 Apr 09 13:30:32 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Created reservations ['87484a54-c5c3-4372-834e-94938e55593e', 'bc7352fb-b143-449d-a8ae-8e6c6d670e46', 'fef51085-cd08-42c3-9a57-fa794031f2d3', 'fdcb379b-050c-4022-aeea-c4adf11f39b7'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:32 devstack sudo[84386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:30:32 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:32 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df 1073741824" returned: 0 in 0.582s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:32 devstack sudo[84392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df Apr 09 13:30:32 devstack sudo[84392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:32 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.515s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:30:32 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Deleted volume successfully. Apr 09 13:30:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-5a4dcf15-53ac-4250-8d62-6951c60aa4c0 tempest-DeleteServersTestJSON-781441953 None] Lock "cinder-a8318cca-f68d-4954-9a02-eba2136045da-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:33 devstack sudo[84392]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df" returned: 0 in 0.558s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfab0b9-4a91-4385-bb06-2548e777deea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc69d39-8c45-4455-b421-be622a9348df', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037d23a8-e7a9-4424-97a9-625b2c4d8f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:33 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Volume volume-fcc69d39-8c45-4455-b421-be622a9348df (fcc69d39-8c45-4455-b421-be622a9348df): created successfully Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037d23a8-e7a9-4424-97a9-625b2c4d8f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Flow 'volume_create_manager' (8cfcf10a-d279-4823-a1a8-e7d39566794a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:33 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d5d5c093-9baa-4824-8dc3-c7bc56b580d8 tempest-GroupsTest-1346184842 None] Created volume successfully. Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG oslo_service.periodic_task [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82346) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:33 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:30:33 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:33 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.556s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:33 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Flow 'volume_create_manager' (3638ce1d-3df1-49b3-b201-928f33f7e552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ddeda1-79cf-44b8-a308-23159795a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ddeda1-79cf-44b8-a308-23159795a096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1325868289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7edad66a-6293-4663-80af-c919a0d46aa2,host='devstack@QuobyteHD#QuobyteHD',id=9fdc3126-d758-472d-b83b-ea0074b05539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56d05933ae4322a0a7d8aee09516c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:34Z,use_quota=True,user_id='512cc5decb5e46f1bf4c2703c698e053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d9b456-5386-43d5-8530-9fea6ad2303f),volume_type_id=34d9b456-5386-43d5-8530-9fea6ad2303f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23940a8e-3d11-46c0-a1b2-ae38d87af65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23940a8e-3d11-46c0-a1b2-ae38d87af65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71873413-8539-48a9-bf4e-ffdc86570394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71873413-8539-48a9-bf4e-ffdc86570394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fdc3126-d758-472d-b83b-ea0074b05539', 'volume_name': 'volume-9fdc3126-d758-472d-b83b-ea0074b05539', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3c5160-a861-499f-8f8c-317ba65eceab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3c5160-a861-499f-8f8c-317ba65eceab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8840a6af-22b7-44aa-b49e-2c91d5311ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:34 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Volume 9fdc3126-d758-472d-b83b-ea0074b05539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fdc3126-d758-472d-b83b-ea0074b05539', 'volume_size': 1} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7edad66a-6293-4663-80af-c919a0d46aa2,created_at=2026-04-09T11:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1325868289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7edad66a-6293-4663-80af-c919a0d46aa2,host='devstack@QuobyteHD#QuobyteHD',id=9fdc3126-d758-472d-b83b-ea0074b05539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56d05933ae4322a0a7d8aee09516c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:34Z,use_quota=True,user_id='512cc5decb5e46f1bf4c2703c698e053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d9b456-5386-43d5-8530-9fea6ad2303f),volume_type_id=34d9b456-5386-43d5-8530-9fea6ad2303f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Creating volume 9fdc3126-d758-472d-b83b-ea0074b05539 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:30:34 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:30:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:34 devstack sudo[84400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539 1073741824 Apr 09 13:30:34 devstack sudo[84400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:35 devstack sudo[84400]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539 1073741824" returned: 0 in 0.586s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:35 devstack sudo[84405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539 Apr 09 13:30:35 devstack sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-56c672dc-03e4-4a44-aee3-078336cb8a3d tempest-GroupsV314Test-1913759858 None] Group tempest-GroupsV314Test-Group-200003081: creating Apr 09 13:30:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-56c672dc-03e4-4a44-aee3-078336cb8a3d tempest-GroupsV314Test-1913759858 None] Group tempest-GroupsV314Test-Group-200003081: created successfully Apr 09 13:30:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-56c672dc-03e4-4a44-aee3-078336cb8a3d tempest-GroupsV314Test-1913759858 None] Create group completed successfully. Apr 09 13:30:35 devstack sudo[84405]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539" returned: 0 in 0.651s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:30:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8840a6af-22b7-44aa-b49e-2c91d5311ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fdc3126-d758-472d-b83b-ea0074b05539', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cb0f03-6fd4-4c6c-ae44-da294fdd6abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:35 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Volume volume-9fdc3126-d758-472d-b83b-ea0074b05539 (9fdc3126-d758-472d-b83b-ea0074b05539): created successfully Apr 09 13:30:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cb0f03-6fd4-4c6c-ae44-da294fdd6abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Flow 'volume_create_manager' (3638ce1d-3df1-49b3-b201-928f33f7e552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-5b06a40c-75f0-4109-8dc8-8dc7e5f8c592 tempest-GroupsTest-1346184842 None] Created volume successfully. Apr 09 13:30:36 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-cd23ab9b-17b8-4588-8515-6264ed45348b tempest-GroupsTest-1346184842 None] Update group completed successfully. Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Flow 'volume_create_manager' (03f7c794-6c52-4b6c-8c51-5645eca1294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab8d8f8-4763-4166-920e-1694a9eaf5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab8d8f8-4763-4166-920e-1694a9eaf5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1226079538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f42a5481-fd1c-40c2-9756-38b7727e250a,host='devstack@QuobyteHD#QuobyteHD',id=2da2ac95-33ea-4f19-8d08-d829aed8a9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46a5f92b0b4400beff862bf79d8985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:37Z,use_quota=True,user_id='b99dcc581a2b4f8a9dc4a8b07caf74b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b08c811-2737-48cb-a567-0871435ff46a),volume_type_id=7b08c811-2737-48cb-a567-0871435ff46a)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d292df2c-512f-40ad-9f7f-2d3feeed3008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d292df2c-512f-40ad-9f7f-2d3feeed3008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91dc7b0-e1c0-46c6-a87b-c0487529276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91dc7b0-e1c0-46c6-a87b-c0487529276c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da2ac95-33ea-4f19-8d08-d829aed8a9dc', 'volume_name': 'volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f29f8c-e072-4449-aade-bfbaf79b57d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f29f8c-e072-4449-aade-bfbaf79b57d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8614582e-d036-48f3-8dab-25d429b82538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:37 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Volume 2da2ac95-33ea-4f19-8d08-d829aed8a9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc', 'volume_size': 1} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f42a5481-fd1c-40c2-9756-38b7727e250a,created_at=2026-04-09T11:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1226079538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f42a5481-fd1c-40c2-9756-38b7727e250a,host='devstack@QuobyteHD#QuobyteHD',id=2da2ac95-33ea-4f19-8d08-d829aed8a9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c46a5f92b0b4400beff862bf79d8985',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:37Z,use_quota=True,user_id='b99dcc581a2b4f8a9dc4a8b07caf74b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b08c811-2737-48cb-a567-0871435ff46a),volume_type_id=7b08c811-2737-48cb-a567-0871435ff46a)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Creating volume 2da2ac95-33ea-4f19-8d08-d829aed8a9dc {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:30:37 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:37 devstack sudo[84427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc 1073741824 Apr 09 13:30:37 devstack sudo[84427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:37 devstack sudo[84427]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc 1073741824" returned: 0 in 0.576s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:37 devstack sudo[84432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc Apr 09 13:30:37 devstack sudo[84432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:38 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-4c4871f2-9eef-4174-a7a2-0deaf7a86c6a tempest-GroupsTest-1346184842 None] Update group completed successfully. Apr 09 13:30:38 devstack sudo[84432]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc" returned: 0 in 0.601s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8614582e-d036-48f3-8dab-25d429b82538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b940ce2-0121-40a3-b613-bb80ad5546aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:38 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Volume volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc (2da2ac95-33ea-4f19-8d08-d829aed8a9dc): created successfully Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b940ce2-0121-40a3-b613-bb80ad5546aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Flow 'volume_create_manager' (03f7c794-6c52-4b6c-8c51-5645eca1294b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:38 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-08f70bb4-93bc-41e7-8b29-bfe59a3ce4b4 tempest-GroupsV314Test-1913759858 None] Created volume successfully. Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Flow 'volume_create_manager' (2e94f161-e670-472e-ae6d-853a8dbb5ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a582421-9f24-48a5-b3b0-f89ef0ee8897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a582421-9f24-48a5-b3b0-f89ef0ee8897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-805377847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2e7725-3074-4220-95a9-40036eb5eb9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77875b61b544439c8daa583e2916e411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:38Z,use_quota=True,user_id='862f71a65f3b42e4a579a2ff423b9f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cee4765-7c16-4835-9432-8d154131b4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cee4765-7c16-4835-9432-8d154131b4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c85138d-edc1-42bc-a827-5592a8172c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c85138d-edc1-42bc-a827-5592a8172c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c2e7725-3074-4220-95a9-40036eb5eb9e', 'volume_name': 'volume-9c2e7725-3074-4220-95a9-40036eb5eb9e', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfab8965-b006-4e06-9be3-55ed44adc659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfab8965-b006-4e06-9be3-55ed44adc659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f91b4a3-bf9a-40b6-a612-3c33d04b22c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:38 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Volume 9c2e7725-3074-4220-95a9-40036eb5eb9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c2e7725-3074-4220-95a9-40036eb5eb9e', 'volume_size': 1} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-805377847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c2e7725-3074-4220-95a9-40036eb5eb9e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77875b61b544439c8daa583e2916e411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:38Z,use_quota=True,user_id='862f71a65f3b42e4a579a2ff423b9f00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Creating volume 9c2e7725-3074-4220-95a9-40036eb5eb9e {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:30:38 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:38 devstack sudo[84435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e 1073741824 Apr 09 13:30:38 devstack sudo[84435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:38 devstack sudo[84435]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e 1073741824" returned: 0 in 0.513s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:38 devstack sudo[84440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e Apr 09 13:30:38 devstack sudo[84440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Acquiring lock "cinder-quobyte-9fdc3126-d758-472d-b83b-ea0074b05539" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Lock "cinder-quobyte-9fdc3126-d758-472d-b83b-ea0074b05539" acquired by "delete_volume" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ceb8d1-1dea-468f-9349-9bfdafb9fd91]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:39 devstack sudo[84440]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e" returned: 0 in 0.494s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f91b4a3-bf9a-40b6-a612-3c33d04b22c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c2e7725-3074-4220-95a9-40036eb5eb9e', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c2d898-4519-406b-a8f4-2dc2be305545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:39 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Volume volume-9c2e7725-3074-4220-95a9-40036eb5eb9e (9c2e7725-3074-4220-95a9-40036eb5eb9e): created successfully Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c2d898-4519-406b-a8f4-2dc2be305545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Flow 'volume_create_manager' (2e94f161-e670-472e-ae6d-853a8dbb5ad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:39 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-4b4ecebd-9c3d-408d-b3c7-10bebe63cd8e req-d1076876-98b5-4fff-913d-7ff015f3ee9c tempest-VolumesGetTestJSON-1549937140 None] Created volume successfully. Apr 09 13:30:39 devstack sudo[84443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539 Apr 09 13:30:39 devstack sudo[84443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Acquiring lock "cinder-9c2e7725-3074-4220-95a9-40036eb5eb9e-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Lock "cinder-9c2e7725-3074-4220-95a9-40036eb5eb9e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Acquiring lock "cinder-quobyte-9c2e7725-3074-4220-95a9-40036eb5eb9e" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Lock "cinder-quobyte-9c2e7725-3074-4220-95a9-40036eb5eb9e" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d620d04f-e211-40b1-b310-97616f8beb2d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:39 devstack sudo[84448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e Apr 09 13:30:39 devstack sudo[84448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:40 devstack sudo[84443]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539" returned: 0 in 0.570s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:40 devstack sudo[84453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539 Apr 09 13:30:40 devstack sudo[84453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:40 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Cloning volume 2da2ac95-33ea-4f19-8d08-d829aed8a9dc to volume 87eb52a4-a305-4eb2-906f-6cca7db95f42 Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Creating offline snapshot 67dc003b-f406-4c17-96d9-7df9ef94e8dd of volume 2da2ac95-33ea-4f19-8d08-d829aed8a9dc {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[013c4d90-1fca-49b0-9fda-4e48d509afac]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:40 devstack sudo[84455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc Apr 09 13:30:40 devstack sudo[84455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:40 devstack sudo[84448]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e" returned: 0 in 0.543s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:40 devstack sudo[84461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e Apr 09 13:30:40 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:40 devstack sudo[84453]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9fdc3126-d758-472d-b83b-ea0074b05539" returned: 0 in 0.454s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Lock "cinder-quobyte-9fdc3126-d758-472d-b83b-ea0074b05539" released by "delete_volume" :: held 1.047s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Acquiring lock "cinder-quobyte-fcc69d39-8c45-4455-b421-be622a9348df" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Lock "cinder-quobyte-fcc69d39-8c45-4455-b421-be622a9348df" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e31989-857b-4457-81f8-842c93cac508]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:40 devstack sudo[84463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df Apr 09 13:30:40 devstack sudo[84463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:40 devstack sudo[84455]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc" returned: 0 in 0.594s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:40 devstack sudo[84468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd 1G Apr 09 13:30:40 devstack sudo[84468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:40 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9c2e7725-3074-4220-95a9-40036eb5eb9e" returned: 0 in 0.451s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Lock "cinder-quobyte-9c2e7725-3074-4220-95a9-40036eb5eb9e" released by "delete_volume" :: held 1.020s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG cinder.quota [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Created reservations ['6beed5bf-787c-43e1-83a6-6982fb70a7a4', 'e954a250-b568-4452-a452-f4e485fbc730', '2221fcf0-56c5-4035-bbdf-90fbd9c63611', 'ec62a908-ecf0-4da8-a268-24db2786d944'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:40 devstack sudo[84474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:30:40 devstack sudo[84474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:41 devstack sudo[84463]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df" returned: 0 in 0.514s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:41 devstack sudo[84476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df Apr 09 13:30:41 devstack sudo[84476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:41 devstack sudo[84468]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd 1G" returned: 0 in 0.706s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:41 devstack sudo[84507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd Apr 09 13:30:41 devstack sudo[84507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:41 devstack sudo[84474]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.615s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:41 devstack cinder-volume[82346]: DEBUG cinder.manager [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:30:41 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Deleted volume successfully. Apr 09 13:30:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-61592bd9-c8d6-4630-8374-b07c1a234123 req-a0830473-ca09-4943-964a-c1335c2e8b22 tempest-VolumesGetTestJSON-1549937140 None] Lock "cinder-9c2e7725-3074-4220-95a9-40036eb5eb9e-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:41 devstack sudo[84476]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fcc69d39-8c45-4455-b421-be622a9348df" returned: 0 in 0.841s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Lock "cinder-quobyte-fcc69d39-8c45-4455-b421-be622a9348df" released by "delete_volume" :: held 1.383s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:41 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Created reservations ['05ba2e8d-e3df-4cc9-b1aa-16ab9676504e'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:42 devstack cinder-volume[82346]: WARNING cinder.quota [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1866975541 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1866975541, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:30:42 devstack cinder-volume[82346]: WARNING cinder.quota [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1866975541 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1866975541, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Created reservations ['8a19ad23-c35f-40f7-b0a3-232cdd83c0d1', 'f4941179-eca5-45bb-9d81-5f469fa12dec', 'e6baea73-2937-4c71-b15c-eb4f2f764c61', '05da2802-d811-48ed-843c-0a5b0bf94095'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Created reservations ['1488359f-7284-48bb-ab33-7523ffb0d414', 'ed36bb48-b126-4844-a987-c2b08747e3a1', 'daca301f-64a7-41fa-b081-10dc69f2efaa', '29ae4c5b-a712-4594-9d7b-6692eb6ec615'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:42 devstack sudo[84517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:30:42 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:42 devstack sudo[84507]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd" returned: 0 in 0.878s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:42 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:42 devstack sudo[84519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd Apr 09 13:30:42 devstack sudo[84519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:42 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.645s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:42 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:30:42 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-aa9805d6-a312-4061-b481-2a49ea26c24a tempest-GroupsTest-1346184842 None] Delete group completed successfully. Apr 09 13:30:43 devstack sudo[84519]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd" returned: 0 in 0.690s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:43 devstack sudo[84523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.info Apr 09 13:30:43 devstack sudo[84523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:43 devstack sudo[84523]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.info" returned: 0 in 0.858s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:43 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:30:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:43 devstack sudo[84527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.info Apr 09 13:30:43 devstack sudo[84527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:44 devstack sudo[84527]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.info" returned: 0 in 0.812s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Acquiring lock "cinder-quobyte-87eb52a4-a305-4eb2-906f-6cca7db95f42" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Lock "cinder-quobyte-87eb52a4-a305-4eb2-906f-6cca7db95f42" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] snapshot: 67dc003b-f406-4c17-96d9-7df9ef94e8dd, volume: 87eb52a4-a305-4eb2-906f-6cca7db95f42, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:30:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:44 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c16d05-b0da-497c-bc34-e3647e63d766]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:44 devstack sudo[84531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd Apr 09 13:30:44 devstack sudo[84531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:45 devstack sudo[84531]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd" returned: 0 in 0.790s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Flow 'volume_create_manager' (4a5da861-91ce-42cd-9ffc-6980c761428b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74560619-d97e-44c9-96f2-71907c5dea8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14e0008-7a8f-4997-bfc8-0c2ba5f05503]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74560619-d97e-44c9-96f2-71907c5dea8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1390126384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b78db19-c560-47da-862f-1e8a11ba7a42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f5db0c8460544899ae61af41c7f3092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:46Z,use_quota=True,user_id='48df7dafcd8a4d9c9b0b22cab2d65381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c65cbc-f0ae-476a-a782-fc4122525652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c65cbc-f0ae-476a-a782-fc4122525652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:45 devstack sudo[84539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc Apr 09 13:30:45 devstack sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c72999c-c0c9-4a1e-8f50-6e6584c9fad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c72999c-c0c9-4a1e-8f50-6e6584c9fad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b78db19-c560-47da-862f-1e8a11ba7a42', 'volume_name': 'volume-6b78db19-c560-47da-862f-1e8a11ba7a42', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cfdb69-6e42-4ecf-b64f-a87c95c8b5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cfdb69-6e42-4ecf-b64f-a87c95c8b5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b6303b-531e-46eb-b8f5-5d7669483435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:45 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Volume 6b78db19-c560-47da-862f-1e8a11ba7a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b78db19-c560-47da-862f-1e8a11ba7a42', 'volume_size': 1} Apr 09 13:30:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:46 devstack sudo[84539]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc" returned: 0 in 0.649s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:46 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:30:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:46 devstack sudo[84550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42 Apr 09 13:30:46 devstack sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Flow 'volume_create_manager' (57cfa9c8-f4a4-425a-a335-d04a1619cd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5c8167-4f45-4124-9d9b-77041de5cd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5c8167-4f45-4124-9d9b-77041de5cd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-519281467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec801c87-dc5a-4700-b260-2b4a3c703ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4eb4809ef4838a0f0faecc0e9dc65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:49Z,use_quota=True,user_id='037edd64f7de4a2dbc19185bc8a0a8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc2c3b8-c51d-4a6d-99be-7f313fc265d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc2c3b8-c51d-4a6d-99be-7f313fc265d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db9e593-3279-49f3-9728-12557c66da36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db9e593-3279-49f3-9728-12557c66da36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec801c87-dc5a-4700-b260-2b4a3c703ee8', 'volume_name': 'volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31676279-1dde-46bc-97fe-22f8d4f6dddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31676279-1dde-46bc-97fe-22f8d4f6dddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d04141-8ffb-4d9e-a001-62e91b19b922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:49 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Volume ec801c87-dc5a-4700-b260-2b4a3c703ee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8', 'volume_size': 1} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:49 devstack sudo[84550]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42" returned: 0 in 2.952s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a28f8ba-eae2-4acf-8f99-0dc6a7663722]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:49 devstack sudo[84596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc Apr 09 13:30:49 devstack sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:49 devstack sudo[84596]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc" returned: 0 in 0.640s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc, size 1024.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:30:49 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Converted 1024.00 MB image at 346.73 MB/s Apr 09 13:30:49 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:30:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:49 devstack sudo[84610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42 Apr 09 13:30:49 devstack sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:50 devstack sudo[84610]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42" returned: 0 in 0.473s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:50 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Lock "cinder-quobyte-87eb52a4-a305-4eb2-906f-6cca7db95f42" released by "_copy_volume_from_snapshot" :: held 5.605s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:50 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Acquiring lock "cinder-quobyte-67dc003b-f406-4c17-96d9-7df9ef94e8dd" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:50 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Lock "cinder-quobyte-67dc003b-f406-4c17-96d9-7df9ef94e8dd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Deleting offline snapshot 67dc003b-f406-4c17-96d9-7df9ef94e8dd of volume 2da2ac95-33ea-4f19-8d08-d829aed8a9dc {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:30:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] snapshot_file for this snap is: volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:30:50 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd78eb0c-31eb-46d0-a777-f79a9f89a31b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:50 devstack sudo[84613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd Apr 09 13:30:50 devstack sudo[84613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:51 devstack sudo[84613]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd" returned: 0 in 0.574s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:30:51 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b5063b-7662-4a39-b890-79ac92186b95]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:51 devstack sudo[84618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc Apr 09 13:30:51 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:51 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc" returned: 0 in 0.591s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:51 devstack sudo[84657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd Apr 09 13:30:51 devstack sudo[84657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:52 devstack sudo[84657]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd" returned: 0 in 0.557s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:52 devstack sudo[84662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd Apr 09 13:30:52 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:52 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc.67dc003b-f406-4c17-96d9-7df9ef94e8dd" returned: 0 in 0.450s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Lock "cinder-quobyte-67dc003b-f406-4c17-96d9-7df9ef94e8dd" released by "_delete_snapshot" :: held 2.251s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.614s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.841s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1390126384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b78db19-c560-47da-862f-1e8a11ba7a42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f5db0c8460544899ae61af41c7f3092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:46Z,use_quota=True,user_id='48df7dafcd8a4d9c9b0b22cab2d65381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Creating volume 6b78db19-c560-47da-862f-1e8a11ba7a42 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:30:52 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:30:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:52 devstack sudo[84665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42 1073741824 Apr 09 13:30:52 devstack sudo[84665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:52 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-0cd6f0a4-69d4-4d07-bc42-5bdb52b4e0da tempest-GroupsV314Test-1913759858 None] Create group from source-group-f42a5481-fd1c-40c2-9756-38b7727e250a completed successfully. Apr 09 13:30:53 devstack sudo[84665]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42 1073741824" returned: 0 in 0.603s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:53 devstack sudo[84674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42 Apr 09 13:30:53 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:53 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42" returned: 0 in 0.460s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.597s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-519281467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec801c87-dc5a-4700-b260-2b4a3c703ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae4eb4809ef4838a0f0faecc0e9dc65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:49Z,use_quota=True,user_id='037edd64f7de4a2dbc19185bc8a0a8b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Creating volume ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:30:53 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b6303b-531e-46eb-b8f5-5d7669483435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b78db19-c560-47da-862f-1e8a11ba7a42', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae0738e-df83-4f1a-bb56-afd6f31b6477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:53 devstack sudo[84679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 1073741824 Apr 09 13:30:53 devstack sudo[84679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:53 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Volume volume-6b78db19-c560-47da-862f-1e8a11ba7a42 (6b78db19-c560-47da-862f-1e8a11ba7a42): created successfully Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae0738e-df83-4f1a-bb56-afd6f31b6477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Flow 'volume_create_manager' (4a5da861-91ce-42cd-9ffc-6980c761428b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:53 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-c7aa1ad3-aa53-4469-88cf-7407fd008c2d tempest-VolumesTestJSON-1923135681 None] Created volume successfully. Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Acquiring lock "cinder-quobyte-87eb52a4-a305-4eb2-906f-6cca7db95f42" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Lock "cinder-quobyte-87eb52a4-a305-4eb2-906f-6cca7db95f42" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[20df6034-5f79-47e6-851b-e515ea89623d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:54 devstack sudo[84681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42 Apr 09 13:30:54 devstack sudo[84681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:54 devstack sudo[84679]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 1073741824" returned: 0 in 0.637s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:54 devstack sudo[84686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 Apr 09 13:30:54 devstack sudo[84686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:54 devstack sudo[84681]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Flow 'volume_create_manager' (59840c7a-f7ad-4b43-9d58-a48c530bed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3957d6e4-606e-4651-93af-3a6d6428c898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3957d6e4-606e-4651-93af-3a6d6428c898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1645338581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223433bf-e083-49a4-8c35-2ab891fafffb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f5db0c8460544899ae61af41c7f3092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:55Z,use_quota=True,user_id='48df7dafcd8a4d9c9b0b22cab2d65381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a969bbb3-4564-4193-80a3-09772cc05758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a969bbb3-4564-4193-80a3-09772cc05758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea40c4fd-cb3b-40bb-82a9-9135c09fa080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea40c4fd-cb3b-40bb-82a9-9135c09fa080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223433bf-e083-49a4-8c35-2ab891fafffb', 'volume_name': 'volume-223433bf-e083-49a4-8c35-2ab891fafffb', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165170f1-a259-4ce8-9cf8-89e1b14808a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165170f1-a259-4ce8-9cf8-89e1b14808a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7dc0166-06cf-490d-abd9-374f77055f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:54 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Volume 223433bf-e083-49a4-8c35-2ab891fafffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223433bf-e083-49a4-8c35-2ab891fafffb', 'volume_size': 1} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42" returned: 0 in 0.685s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:54 devstack sudo[84691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42 Apr 09 13:30:54 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:55 devstack sudo[84686]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8" returned: 0 in 0.543s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.187s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1645338581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223433bf-e083-49a4-8c35-2ab891fafffb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f5db0c8460544899ae61af41c7f3092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:55Z,use_quota=True,user_id='48df7dafcd8a4d9c9b0b22cab2d65381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Creating volume 223433bf-e083-49a4-8c35-2ab891fafffb {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:30:55 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d04141-8ffb-4d9e-a001-62e91b19b922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3039ae0d-57a3-4ca4-b53a-6aa5efaad752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:55 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Volume volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 (ec801c87-dc5a-4700-b260-2b4a3c703ee8): created successfully Apr 09 13:30:55 devstack sudo[84694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb 1073741824 Apr 09 13:30:55 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3039ae0d-57a3-4ca4-b53a-6aa5efaad752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Flow 'volume_create_manager' (57cfa9c8-f4a4-425a-a335-d04a1619cd14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:55 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-aec0e2d4-094e-444e-af02-d591cf02b0f9 tempest-SnapshotsActionsTest-1813267922 None] Created volume successfully. Apr 09 13:30:55 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-87eb52a4-a305-4eb2-906f-6cca7db95f42" returned: 0 in 0.466s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Lock "cinder-quobyte-87eb52a4-a305-4eb2-906f-6cca7db95f42" released by "delete_volume" :: held 1.199s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Created reservations ['51c299bd-7b7a-4077-92e7-181f2618ffc9'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:55 devstack cinder-volume[82346]: WARNING cinder.quota [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1805554273 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1805554273, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:30:55 devstack cinder-volume[82346]: WARNING cinder.quota [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1805554273 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1805554273, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Created reservations ['5a7782cc-c3e1-41b9-a18b-89dfcb19a950', 'd277214c-3175-4381-8743-c3914ddec50d', 'ea191b2c-7098-4254-8d8b-990815af0684', '5b55112d-5ca9-4387-9499-781e44aaa088'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:55 devstack sudo[84697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:30:55 devstack sudo[84697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:55 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb 1073741824" returned: 0 in 0.700s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:55 devstack sudo[84703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb Apr 09 13:30:55 devstack sudo[84703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:55 devstack sudo[84697]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.470s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:55 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:30:55 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-622fd3dc-e046-446c-a4a8-05dc53bf5703 tempest-GroupsV314Test-1913759858 None] Delete group completed successfully. Apr 09 13:30:56 devstack sudo[84703]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb" returned: 0 in 0.449s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.687s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] Creating offline snapshot 84fcadfe-fedc-425b-ab5b-f1bd95e4138a of volume ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7dc0166-06cf-490d-abd9-374f77055f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223433bf-e083-49a4-8c35-2ab891fafffb', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bc0421-81c9-4838-81a2-6be3a31a841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:56 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Volume volume-223433bf-e083-49a4-8c35-2ab891fafffb (223433bf-e083-49a4-8c35-2ab891fafffb): created successfully Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bc0421-81c9-4838-81a2-6be3a31a841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Flow 'volume_create_manager' (59840c7a-f7ad-4b43-9d58-a48c530bed32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc33f6-4515-4696-a0bc-88c179b62900]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:56 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2dffcf4b-e056-4eee-ade3-c30471094949 tempest-VolumesTestJSON-1923135681 None] Created volume successfully. Apr 09 13:30:56 devstack sudo[84707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 Apr 09 13:30:56 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Acquiring lock "cinder-quobyte-2da2ac95-33ea-4f19-8d08-d829aed8a9dc" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Lock "cinder-quobyte-2da2ac95-33ea-4f19-8d08-d829aed8a9dc" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a910e12e-a0c2-400e-ae51-df273a33f7e5]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:56 devstack sudo[84709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc Apr 09 13:30:56 devstack sudo[84709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:56 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8" returned: 0 in 0.607s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:56 devstack sudo[84714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a 1G Apr 09 13:30:56 devstack sudo[84714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:57 devstack sudo[84709]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc" returned: 0 in 0.574s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:57 devstack sudo[84719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc Apr 09 13:30:57 devstack sudo[84719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:57 devstack sudo[84714]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a 1G" returned: 0 in 0.762s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:57 devstack sudo[84725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:30:57 devstack sudo[84725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Flow 'volume_create_manager' (2582681c-e96b-4f11-8fcf-2f3d0ef7a8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1b0f4d-1a84-46bb-a509-49641e1dfb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1b0f4d-1a84-46bb-a509-49641e1dfb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-172528295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57059a3-696e-4d4c-9620-dd101113dbc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f5db0c8460544899ae61af41c7f3092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:58Z,use_quota=True,user_id='48df7dafcd8a4d9c9b0b22cab2d65381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b25f32e-aa8a-4d16-81b3-0418c544bbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b25f32e-aa8a-4d16-81b3-0418c544bbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8542edf0-4cfb-43ec-8e34-a366000dddae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8542edf0-4cfb-43ec-8e34-a366000dddae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57059a3-696e-4d4c-9620-dd101113dbc1', 'volume_name': 'volume-b57059a3-696e-4d4c-9620-dd101113dbc1', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3551de4f-64f2-4566-847d-47432c678249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3551de4f-64f2-4566-847d-47432c678249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:57 devstack sudo[84719]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e6e2c9-3e62-4e88-a19a-6981314b390f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:57 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Volume b57059a3-696e-4d4c-9620-dd101113dbc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57059a3-696e-4d4c-9620-dd101113dbc1', 'volume_size': 1} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2da2ac95-33ea-4f19-8d08-d829aed8a9dc" returned: 0 in 0.761s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Lock "cinder-quobyte-2da2ac95-33ea-4f19-8d08-d829aed8a9dc" released by "delete_volume" :: held 1.398s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Created reservations ['52fdbb5c-724b-4363-b069-f28b9133a5e6'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:57 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Created reservations ['4adce74f-16bd-43e7-b854-c4ea4dad169a', '1ff37e18-d4c5-49dd-8cbc-6b9ffb6d6a08', '86c9e8a9-eae5-424e-936b-e746e9d8fb1a', '55f6d124-fd27-468c-a960-4eb07a0cd1e5'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:58 devstack sudo[84727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:30:58 devstack sudo[84727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:58 devstack sudo[84725]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.706s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:58 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a is being set with open permissions: ugo+rw Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:58 devstack sudo[84732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:30:58 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:58 devstack sudo[84727]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.526s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:30:58 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-eb9988d2-6502-49d7-bec2-8b22ddc650cb tempest-GroupsV314Test-1913759858 None] Delete group completed successfully. Apr 09 13:30:58 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.554s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:59 devstack sudo[84736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.info Apr 09 13:30:59 devstack sudo[84736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:30:59 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:30:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Flow 'volume_create_manager' (d3f24d78-5e89-4290-8f00-839b63b15e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:30:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec414d4c-2fa7-4250-842f-740eeb7f53ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:59 devstack sudo[84736]: pam_unix(sudo:session): session closed for user root Apr 09 13:30:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec414d4c-2fa7-4250-842f-740eeb7f53ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:31:00Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522094e1-e2ac-4253-875d-931ee6860729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f1f8c4fa334bd0b82e03832912e6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:00Z,use_quota=True,user_id='5758bd0c11fc40ac8af8c94b13553de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048cc8cf-ac62-445f-81d4-5709383d5301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048cc8cf-ac62-445f-81d4-5709383d5301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:30:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37565e5-af87-4238-a87a-a273eabe0d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:30:59 devstack cinder-volume[82346]: DEBUG cinder.image.glance [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Creating Keystone auth plugin from conf {{(pid=82346) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 13:30:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.info" returned: 0 in 0.915s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:30:59 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.info is being set with open permissions: ugo+rw Apr 09 13:30:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:30:59 devstack sudo[84742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.info Apr 09 13:30:59 devstack sudo[84742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37565e5-af87-4238-a87a-a273eabe0d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '522094e1-e2ac-4253-875d-931ee6860729', 'volume_name': 'volume-522094e1-e2ac-4253-875d-931ee6860729', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b43dc84-706d-4e4f-b31d-d5ec15d17eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b43dc84-706d-4e4f-b31d-d5ec15d17eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66e5d25-9538-4417-aa1a-0fb453ee6dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:00 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Volume 522094e1-e2ac-4253-875d-931ee6860729: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-522094e1-e2ac-4253-875d-931ee6860729', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Trying to clone 522094e1-e2ac-4253-875d-931ee6860729 from image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e at location (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]). {{(pid=82346) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 13:31:00 devstack sudo[84742]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.info" returned: 0 in 0.499s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.194s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.571s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-172528295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57059a3-696e-4d4c-9620-dd101113dbc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f5db0c8460544899ae61af41c7f3092',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:30:58Z,use_quota=True,user_id='48df7dafcd8a4d9c9b0b22cab2d65381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Creating volume b57059a3-696e-4d4c-9620-dd101113dbc1 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:31:00 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:00 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-8d545c0d-ae18-4975-b319-50f7ec8fa0b6 tempest-SnapshotsActionsTest-1813267922 None] Create snapshot completed successfully Apr 09 13:31:00 devstack sudo[84765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1 1073741824 Apr 09 13:31:00 devstack sudo[84765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 13:31:00 devstack cinder-volume[82346]: INFO cinder.image.image_utils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Image download 20.69 MB at 20.69 MB/s Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9669bb-e003-4a21-a7b3-71d39c08cc3d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:00 devstack sudo[84785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD Apr 09 13:31:00 devstack sudo[84785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:01 devstack sudo[84765]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1 1073741824" returned: 0 in 0.860s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:01 devstack sudo[84793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1 Apr 09 13:31:01 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:01 devstack sudo[84785]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:01 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Temporary image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e is fetched for user 5758bd0c11fc40ac8af8c94b13553de4. {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 13:31:01 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83bc093-6bfb-4517-b5c5-22c30e47e8b7]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:01 devstack sudo[84795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD Apr 09 13:31:01 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:02 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1" returned: 0 in 0.860s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.711s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] Creating offline snapshot b399c1df-1bf0-419f-a860-ba93ad0973b5 of volume ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e6e2c9-3e62-4e88-a19a-6981314b390f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57059a3-696e-4d4c-9620-dd101113dbc1', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd8f5b1-9f0e-4fb7-93b2-db2960b3cb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4bd313-2cae-42ec-be9e-ddafa324aeb3]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:02 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Volume volume-b57059a3-696e-4d4c-9620-dd101113dbc1 (b57059a3-696e-4d4c-9620-dd101113dbc1): created successfully Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cd8f5b1-9f0e-4fb7-93b2-db2960b3cb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Flow 'volume_create_manager' (2582681c-e96b-4f11-8fcf-2f3d0ef7a8bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:31:02 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-fa10b9d7-cd6f-40c7-b655-5d6873102fc2 tempest-VolumesTestJSON-1923135681 None] Created volume successfully. Apr 09 13:31:02 devstack sudo[84798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:31:02 devstack sudo[84798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:02 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD" returned: 0 in 0.895s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:02 devstack sudo[84798]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.618s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:02 devstack sudo[84806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 1G Apr 09 13:31:02 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:03 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 1G" returned: 0 in 0.754s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:03 devstack sudo[84817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 Apr 09 13:31:03 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:03 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f5e0e91c-59d1-4046-988e-325d132b3eb4 tempest-GroupsV320Test-855103613 None] Group tempest-GroupsV320Test-Group-910386418: creating Apr 09 13:31:03 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f5e0e91c-59d1-4046-988e-325d132b3eb4 tempest-GroupsV320Test-855103613 None] Group tempest-GroupsV320Test-Group-910386418: created successfully Apr 09 13:31:04 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f5e0e91c-59d1-4046-988e-325d132b3eb4 tempest-GroupsV320Test-855103613 None] Create group completed successfully. Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "cinder-b57059a3-696e-4d4c-9620-dd101113dbc1-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-b57059a3-696e-4d4c-9620-dd101113dbc1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "cinder-quobyte-b57059a3-696e-4d4c-9620-dd101113dbc1" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-quobyte-b57059a3-696e-4d4c-9620-dd101113dbc1" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:04 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5" returned: 0 in 0.511s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:04 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 is being set with open permissions: ugo+rw Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd65c120-20dd-4d77-aa0d-32632ac2dc7d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:04 devstack sudo[84822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 Apr 09 13:31:04 devstack sudo[84822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:04 devstack sudo[84823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1 Apr 09 13:31:04 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:04 devstack sudo[84822]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5" returned: 0 in 0.456s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.135s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:31:00Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522094e1-e2ac-4253-875d-931ee6860729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f1f8c4fa334bd0b82e03832912e6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:00Z,use_quota=True,user_id='5758bd0c11fc40ac8af8c94b13553de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Creating volume 522094e1-e2ac-4253-875d-931ee6860729 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:31:04 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:04 devstack sudo[84838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 1073741824 Apr 09 13:31:04 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:04 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-8fc15b47-3fa5-473d-84da-412d25964d5d tempest-SnapshotsActionsTest-1813267922 None] Create snapshot completed successfully Apr 09 13:31:04 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1" returned: 0 in 0.609s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:04 devstack sudo[84841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1 Apr 09 13:31:04 devstack sudo[84841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:05 devstack sudo[84841]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b57059a3-696e-4d4c-9620-dd101113dbc1" returned: 0 in 0.435s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-quobyte-b57059a3-696e-4d4c-9620-dd101113dbc1" released by "delete_volume" :: held 1.075s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Created reservations ['a762c10b-32cd-4542-9ec7-bdcd8ac69eb5', '61f6e3b1-059b-46b1-9d9a-5316b404015b', '9bdab40c-cb3c-404e-940d-85900deb818f', '0f90967a-267f-455a-8aef-e07baa5954ec'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:05 devstack sudo[84847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:31:05 devstack sudo[84847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:05 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 1073741824" returned: 0 in 0.694s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-9cacfb40-c5d0-4875-ac44-527d749a36e7 tempest-GroupsV320Test-855103613 None] Created reservations ['fd8706e2-f357-49b2-ab48-31eed94ef9c7'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:05 devstack sudo[84849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 Apr 09 13:31:05 devstack sudo[84849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9cacfb40-c5d0-4875-ac44-527d749a36e7 tempest-GroupsV320Test-855103613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9cacfb40-c5d0-4875-ac44-527d749a36e7 tempest-GroupsV320Test-855103613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9cacfb40-c5d0-4875-ac44-527d749a36e7 tempest-GroupsV320Test-855103613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9cacfb40-c5d0-4875-ac44-527d749a36e7 tempest-GroupsV320Test-855103613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9cacfb40-c5d0-4875-ac44-527d749a36e7 tempest-GroupsV320Test-855103613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9cacfb40-c5d0-4875-ac44-527d749a36e7 tempest-GroupsV320Test-855103613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:05 devstack sudo[84851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:31:05 devstack sudo[84851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-b399c1df-1bf0-419f-a860-ba93ad0973b5-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-b399c1df-1bf0-419f-a860-ba93ad0973b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:06 devstack sudo[84851]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-quobyte-b399c1df-1bf0-419f-a860-ba93ad0973b5" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9cacfb40-c5d0-4875-ac44-527d749a36e7 tempest-GroupsV320Test-855103613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.554s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-9cacfb40-c5d0-4875-ac44-527d749a36e7 tempest-GroupsV320Test-855103613 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:31:06 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-9cacfb40-c5d0-4875-ac44-527d749a36e7 tempest-GroupsV320Test-855103613 None] Delete group completed successfully. Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-b399c1df-1bf0-419f-a860-ba93ad0973b5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:06 devstack sudo[84849]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Deleting offline snapshot b399c1df-1bf0-419f-a860-ba93ad0973b5 of volume ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] snapshot_file for this snap is: volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729" returned: 0 in 0.643s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0e7b48-3406-4b14-9637-b372429f55b0]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:06 devstack sudo[84847]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.779s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Attempting download of eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e ((None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}])) to volume 522094e1-e2ac-4253-875d-931ee6860729. {{(pid=82346) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 13:31:06 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Deleted volume successfully. Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-749dce30-3477-41e2-b304-1e9194429a04 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-b57059a3-696e-4d4c-9620-dd101113dbc1-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d0fcc5-128a-40fb-8074-0b50c3105b4f]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_ygr9qyhh {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:06 devstack sudo[84857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 Apr 09 13:31:06 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:06 devstack sudo[84858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_ygr9qyhh Apr 09 13:31:06 devstack sudo[84858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "cinder-223433bf-e083-49a4-8c35-2ab891fafffb-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-223433bf-e083-49a4-8c35-2ab891fafffb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "cinder-quobyte-223433bf-e083-49a4-8c35-2ab891fafffb" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-quobyte-223433bf-e083-49a4-8c35-2ab891fafffb" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f415f02f-bfd8-49c0-94d3-5fb205501749]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:06 devstack sudo[84861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb Apr 09 13:31:06 devstack sudo[84861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:06 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5" returned: 0 in 0.647s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bfa2d4-5bcf-41f5-b0d4-a936cfddb73f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:06 devstack sudo[84866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:31:06 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:07 devstack sudo[84858]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_ygr9qyhh" returned: 0 in 0.833s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_ygr9qyhh {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:07 devstack sudo[84861]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb" returned: 0 in 0.756s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:07 devstack sudo[84874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb Apr 09 13:31:07 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:07 devstack sudo[84873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_ygr9qyhh Apr 09 13:31:07 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:07 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.843s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:07 devstack sudo[84881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 Apr 09 13:31:07 devstack sudo[84881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:07 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_ygr9qyhh" returned: 1 in 0.838s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_ygr9qyhh' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa244849-d8d1-4e8e-98c7-ca3c736baefe]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:07 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-223433bf-e083-49a4-8c35-2ab891fafffb" returned: 0 in 0.746s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-quobyte-223433bf-e083-49a4-8c35-2ab891fafffb" released by "delete_volume" :: held 1.531s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:07 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Created reservations ['e3070d48-66d9-427d-85a8-8259b807294c', '4a87bfe7-1eb2-4d9d-82bf-1504c739ead4', '3d1f8336-7d4e-4a47-b01c-b1732fc6cc53', 'fbdf3e46-122c-44d1-b247-83dd7ced1cd1'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:08 devstack sudo[84885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD Apr 09 13:31:08 devstack sudo[84885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:08 devstack sudo[84887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:31:08 devstack sudo[84887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:08 devstack sudo[84881]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5" returned: 0 in 0.789s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:08 devstack sudo[84892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5 Apr 09 13:31:08 devstack sudo[84892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "cinder-6b78db19-c560-47da-862f-1e8a11ba7a42-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-6b78db19-c560-47da-862f-1e8a11ba7a42-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "cinder-quobyte-6b78db19-c560-47da-862f-1e8a11ba7a42" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-quobyte-6b78db19-c560-47da-862f-1e8a11ba7a42" acquired by "delete_volume" :: waited 0.019s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9b4d5e-b8d7-4d36-81f0-7102e2846964]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:08 devstack sudo[84887]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.742s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:31:08 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Deleted volume successfully. Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0c2ed8e9-77e0-46c4-a1e7-248df2991b46 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-223433bf-e083-49a4-8c35-2ab891fafffb-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:08 devstack sudo[84895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42 Apr 09 13:31:08 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:08 devstack sudo[84885]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD" returned: 0 in 1.093s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e was qcow2, converting to raw {{(pid=82346) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 13:31:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:09 devstack sudo[84900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 Apr 09 13:31:09 devstack sudo[84900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:09 devstack sudo[84892]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.b399c1df-1bf0-419f-a860-ba93ad0973b5" returned: 0 in 0.812s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-b399c1df-1bf0-419f-a860-ba93ad0973b5" released by "_delete_snapshot" :: held 3.187s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" released by "delete_snapshot" :: held 3.212s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:09 devstack cinder-volume[82346]: WARNING cinder.quota [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:31:09 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Created reservations ['7fdcff46-edbc-4288-88f6-4b061d20a931', '758b91ab-6439-4ff0-8a4a-9040e49ef5d7', 'a9186556-46bf-4b94-8447-3aa621c2dbe6', 'd185bcd7-8366-4bcb-b955-f28630507ec5'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:09 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Delete snapshot completed successfully. Apr 09 13:31:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a3b11cdd-296e-470e-80b0-be50726ee077 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-b399c1df-1bf0-419f-a860-ba93ad0973b5-delete_snapshot" released by "delete_snapshot" :: held 3.388s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:09 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42" returned: 0 in 0.865s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:09 devstack sudo[84921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42 Apr 09 13:31:09 devstack sudo[84921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:10 devstack sudo[84921]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6b78db19-c560-47da-862f-1e8a11ba7a42" returned: 0 in 0.589s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-quobyte-6b78db19-c560-47da-862f-1e8a11ba7a42" released by "delete_volume" :: held 1.506s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Created reservations ['3ebb6f32-5ea4-4c6d-b93a-cec856430ef5', '56690825-2aa1-48cb-bf45-aced52ece28a', '22b19751-5225-4365-8bb0-a3ac0c5a3eb5', '6a7fb4b8-99ba-4f4a-9991-752d8141cc31'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:10 devstack sudo[84924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:31:10 devstack sudo[84924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:10 devstack sudo[84900]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729" returned: 0 in 1.546s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_fzcigjnsdevstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:31:10 devstack cinder-volume[82346]: INFO cinder.image.image_utils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Converted 112.00 MB image at 72.37 MB/s Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:10 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 1G Apr 09 13:31:10 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] Creating offline snapshot 6e330d6f-f015-4cd3-b601-61c537b3c22a of volume ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11e227c-2d35-4ae3-83e8-a8db5b162437]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:10 devstack sudo[84928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:31:10 devstack sudo[84928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:10 devstack sudo[84924]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.628s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:31:10 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Deleted volume successfully. Apr 09 13:31:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-03b0f9f5-9649-41c9-a0cd-e799126cdd51 tempest-VolumesTestJSON-1923135681 None] Lock "cinder-6b78db19-c560-47da-862f-1e8a11ba7a42-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:11 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 1G" returned: 0 in 0.750s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:11 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c732e99-275c-489c-a0a0-a17f9a86c5cc]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:11 devstack sudo[84934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 Apr 09 13:31:11 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:11 devstack sudo[84928]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 1.048s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:11 devstack sudo[84939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a 1G Apr 09 13:31:11 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:12 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729" returned: 0 in 0.752s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:12 devstack sudo[84943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 Apr 09 13:31:12 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:12 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a 1G" returned: 0 in 0.973s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:12 devstack sudo[84951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a Apr 09 13:31:12 devstack sudo[84951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:12 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729" returned: 1 in 0.820s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:31:12 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Downloaded image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e ((None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}])) to volume 522094e1-e2ac-4253-875d-931ee6860729 successfully. {{(pid=82346) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 13:31:12 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Temporary image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e for user 5758bd0c11fc40ac8af8c94b13553de4 is deleted. {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 13:31:12 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Marking volume 522094e1-e2ac-4253-875d-931ee6860729 as bootable. {{(pid=82346) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 13:31:12 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Copying metadata from image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e to 522094e1-e2ac-4253-875d-931ee6860729. {{(pid=82346) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 13:31:12 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Creating volume glance metadata for volume 522094e1-e2ac-4253-875d-931ee6860729 backed by image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82346) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 13:31:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66e5d25-9538-4417-aa1a-0fb453ee6dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522094e1-e2ac-4253-875d-931ee6860729', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de29c9d1-d056-4047-a309-3bcfb28c6732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:13 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Volume volume-522094e1-e2ac-4253-875d-931ee6860729 (522094e1-e2ac-4253-875d-931ee6860729): created successfully Apr 09 13:31:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de29c9d1-d056-4047-a309-3bcfb28c6732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Flow 'volume_create_manager' (d3f24d78-5e89-4290-8f00-839b63b15e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:31:13 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-bd3c73cf-a9a7-41db-a646-95f98c14a185 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Created volume successfully. Apr 09 13:31:13 devstack sudo[84951]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a" returned: 0 in 0.792s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:13 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a is being set with open permissions: ugo+rw Apr 09 13:31:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:13 devstack sudo[84956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a Apr 09 13:31:13 devstack sudo[84956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:14 devstack sudo[84956]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a" returned: 0 in 0.722s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.617s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:14 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-033c2998-ac68-4c30-ace0-22354fedd4a3 tempest-SnapshotsActionsTest-1813267922 None] Create snapshot completed successfully Apr 09 13:31:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-6e330d6f-f015-4cd3-b601-61c537b3c22a-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-6e330d6f-f015-4cd3-b601-61c537b3c22a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-quobyte-6e330d6f-f015-4cd3-b601-61c537b3c22a" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-6e330d6f-f015-4cd3-b601-61c537b3c22a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Deleting offline snapshot 6e330d6f-f015-4cd3-b601-61c537b3c22a of volume ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:31:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] snapshot_file for this snap is: volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:31:15 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d72218-6111-4c09-b890-b98d569413ba]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:15 devstack sudo[84959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a Apr 09 13:31:15 devstack sudo[84959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-a9a88efb-ed65-4e68-a99e-1a1182b5352a tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-a9a88efb-ed65-4e68-a99e-1a1182b5352a tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:15 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb62da1-fbf1-4ade-8c19-96ce5bf65896]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-a9a88efb-ed65-4e68-a99e-1a1182b5352a tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:15 devstack sudo[84959]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a" returned: 0 in 0.798s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:15 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ebe0bd-e13d-488b-8dcf-e29049069040]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:15 devstack sudo[84973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 Apr 09 13:31:15 devstack sudo[84973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:15 devstack sudo[84974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:31:15 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:16 devstack sudo[84973]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-a9a88efb-ed65-4e68-a99e-1a1182b5352a tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729" returned: 0 in 0.625s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-a9a88efb-ed65-4e68-a99e-1a1182b5352a tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:16 devstack sudo[84983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 Apr 09 13:31:16 devstack sudo[84983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:16 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.634s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:16 devstack sudo[84985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a Apr 09 13:31:16 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:16 devstack sudo[84983]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-a9a88efb-ed65-4e68-a99e-1a1182b5352a tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729" returned: 1 in 0.553s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-a9a88efb-ed65-4e68-a99e-1a1182b5352a tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:31:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-a9a88efb-ed65-4e68-a99e-1a1182b5352a tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.221s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-a9a88efb-ed65-4e68-a99e-1a1182b5352a tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0', 'name': 'volume-522094e1-e2ac-4253-875d-931ee6860729', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7afe12a-f69f-4bf6-94f3-92fbcc99ab82', 'enforce_multipath': True} {{(pid=82346) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 09 13:31:17 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-62f79361-9c4e-449a-843c-2642c2dfd8f8 req-a9a88efb-ed65-4e68-a99e-1a1182b5352a tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] attachment_update completed successfully. Apr 09 13:31:17 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a" returned: 0 in 0.774s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:17 devstack sudo[84993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a Apr 09 13:31:17 devstack sudo[84993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:17 devstack sudo[84993]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.6e330d6f-f015-4cd3-b601-61c537b3c22a" returned: 0 in 0.486s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-6e330d6f-f015-4cd3-b601-61c537b3c22a" released by "_delete_snapshot" :: held 2.764s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" released by "delete_snapshot" :: held 2.788s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:17 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Created reservations ['67af6a87-cff3-46e7-99bb-f5fb128cfbd1', 'c95c077f-05aa-4cd1-873d-947cbcfe6f33', '97ed83c9-526a-43d4-8d92-49249c140edc', '6ef8c3ee-dd9c-4e63-9f5b-354c7c2cf9cf'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:17 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Delete snapshot completed successfully. Apr 09 13:31:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6c0730b1-3d6a-4430-9d70-bbaa72aa426f tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-6e330d6f-f015-4cd3-b601-61c537b3c22a-delete_snapshot" released by "delete_snapshot" :: held 2.881s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] Creating offline snapshot 76f6402b-7e97-441a-90f9-d52ead7128cb of volume ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:31:18 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[91757487-eb42-4d15-ab42-ca796be05a72]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:18 devstack sudo[84996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:31:18 devstack sudo[84996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:19 devstack sudo[84996]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.628s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:31:19 devstack sudo[85001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb 1G Apr 09 13:31:19 devstack sudo[85001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Flow 'volume_create_manager' (416f4dd9-2262-4acf-a17b-d262ecc0eb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e172d80f-52c4-4c94-b5e1-725c5c0008dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e172d80f-52c4-4c94-b5e1-725c5c0008dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-106895305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0604faa3-4734-4dff-8ce2-acecd800af16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fca9a6b7ec4dc7b71ad9a922a96dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:19Z,use_quota=True,user_id='a8cc266dff514089994162995e263dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (368d9055-a9fd-4780-aebd-4af65421a025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (368d9055-a9fd-4780-aebd-4af65421a025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6b807e-ff97-401f-8fd2-548d95c6f88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d6b807e-ff97-401f-8fd2-548d95c6f88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0604faa3-4734-4dff-8ce2-acecd800af16', 'volume_name': 'volume-0604faa3-4734-4dff-8ce2-acecd800af16', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de002feb-8c92-460d-807f-29064b7e1642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de002feb-8c92-460d-807f-29064b7e1642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f871d6d-217d-467e-9b02-7ac65509ccd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:19 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Volume 0604faa3-4734-4dff-8ce2-acecd800af16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0604faa3-4734-4dff-8ce2-acecd800af16', 'volume_size': 1} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:19 devstack sudo[85001]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb 1G" returned: 0 in 0.668s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:19 devstack sudo[85006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb Apr 09 13:31:19 devstack sudo[85006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:20 devstack sudo[85006]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb" returned: 0 in 0.526s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:20 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb is being set with open permissions: ugo+rw Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:20 devstack sudo[85014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb Apr 09 13:31:20 devstack sudo[85014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:20 devstack sudo[85014]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb" returned: 0 in 0.537s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.445s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.677s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-106895305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0604faa3-4734-4dff-8ce2-acecd800af16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fca9a6b7ec4dc7b71ad9a922a96dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:19Z,use_quota=True,user_id='a8cc266dff514089994162995e263dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Creating volume 0604faa3-4734-4dff-8ce2-acecd800af16 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:31:20 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:31:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:20 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-afb8716f-470c-4cc1-af77-aefaa43d5864 tempest-SnapshotsActionsTest-1813267922 None] Create snapshot completed successfully Apr 09 13:31:20 devstack sudo[85017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16 1073741824 Apr 09 13:31:20 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:21 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16 1073741824" returned: 0 in 0.786s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-76f6402b-7e97-441a-90f9-d52ead7128cb-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-76f6402b-7e97-441a-90f9-d52ead7128cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:21 devstack sudo[85041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16 Apr 09 13:31:21 devstack sudo[85041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-quobyte-76f6402b-7e97-441a-90f9-d52ead7128cb" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-76f6402b-7e97-441a-90f9-d52ead7128cb" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Deleting offline snapshot 76f6402b-7e97-441a-90f9-d52ead7128cb of volume ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] snapshot_file for this snap is: volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c7dbb4-5cc0-40b7-a971-f60a89a1efe0]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:22 devstack sudo[85048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb Apr 09 13:31:22 devstack sudo[85048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:22 devstack sudo[85041]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16" returned: 0 in 1.081s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:31:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f871d6d-217d-467e-9b02-7ac65509ccd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0604faa3-4734-4dff-8ce2-acecd800af16', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5807666-d8eb-40a2-8675-88d89cfa427b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:22 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Volume volume-0604faa3-4734-4dff-8ce2-acecd800af16 (0604faa3-4734-4dff-8ce2-acecd800af16): created successfully Apr 09 13:31:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5807666-d8eb-40a2-8675-88d89cfa427b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Flow 'volume_create_manager' (416f4dd9-2262-4acf-a17b-d262ecc0eb03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:31:22 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-cafb5a1f-631d-4567-aba4-e522ea455792 tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Created volume successfully. Apr 09 13:31:22 devstack sudo[85048]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb" returned: 0 in 1.136s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:23 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da62d5b-de86-40e5-8a41-3d96af92c88b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:23 devstack sudo[85057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:31:23 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:23 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.612s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:23 devstack sudo[85062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb Apr 09 13:31:23 devstack sudo[85062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Acquiring lock "cinder-0604faa3-4734-4dff-8ce2-acecd800af16-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Lock "cinder-0604faa3-4734-4dff-8ce2-acecd800af16-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:24 devstack sudo[85062]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Acquiring lock "cinder-quobyte-0604faa3-4734-4dff-8ce2-acecd800af16" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb" returned: 0 in 0.932s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Lock "cinder-quobyte-0604faa3-4734-4dff-8ce2-acecd800af16" acquired by "delete_volume" :: waited 0.029s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:24 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[142e26ba-665e-4aeb-a7d6-dd11daacd1b2]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:24 devstack sudo[85068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb Apr 09 13:31:24 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:24 devstack sudo[85070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16 Apr 09 13:31:24 devstack sudo[85070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:25 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.76f6402b-7e97-441a-90f9-d52ead7128cb" returned: 0 in 0.688s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-76f6402b-7e97-441a-90f9-d52ead7128cb" released by "_delete_snapshot" :: held 3.515s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" released by "delete_snapshot" :: held 3.537s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:25 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Created reservations ['e3d5a0c3-8026-4781-81ae-da412efa92ee', 'd1f70ddc-32ba-4ea2-9a59-483bc6aefd07', '4b2737a4-22c2-4567-a2ec-187027b702f3', '7afdd218-ac7e-4cc1-b154-4108307201bc'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:25 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Delete snapshot completed successfully. Apr 09 13:31:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3627dc60-39e7-4731-8229-26d2d1522e67 tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-76f6402b-7e97-441a-90f9-d52ead7128cb-delete_snapshot" released by "delete_snapshot" :: held 3.656s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:25 devstack sudo[85070]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16" returned: 0 in 0.802s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:25 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16 Apr 09 13:31:25 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:26 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0604faa3-4734-4dff-8ce2-acecd800af16" returned: 0 in 0.632s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Lock "cinder-quobyte-0604faa3-4734-4dff-8ce2-acecd800af16" released by "delete_volume" :: held 1.472s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Created reservations ['44ce761a-9eec-4781-a34d-de258083d88b', 'aba2c0c7-10f9-466a-a17f-61ec992e145d', '4ddb01e4-f80c-4056-95a6-2a4c574681c7', '34c892a1-073d-4679-8157-1f87d67a0ee0'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:26 devstack sudo[85080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:31:26 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=162,cinder:UPDATE=160,cinder:INSERT=43,cinder:DELETE=12 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=151,cinder:UPDATE=173,cinder:INSERT=45,cinder:DELETE=7 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] Creating offline snapshot 7a018648-a7b8-4fb0-9e5a-37a2659b263c of volume ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7457537-69ff-4cf7-b9ab-27947b0c7773]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:26 devstack sudo[85083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:31:26 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:26 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.593s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:31:26 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Deleted volume successfully. Apr 09 13:31:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ad24f4f0-e3a6-42a5-bab9-557db9b8025f tempest-VolumeQuotasNegativeTestJSON-1686833129 None] Lock "cinder-0604faa3-4734-4dff-8ce2-acecd800af16-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:27 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.794s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:27 devstack sudo[85089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c 1G Apr 09 13:31:27 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:28 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c 1G" returned: 0 in 0.902s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:28 devstack sudo[85094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c Apr 09 13:31:28 devstack sudo[85094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:28 devstack sudo[85094]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c" returned: 0 in 0.545s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:28 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c is being set with open permissions: ugo+rw Apr 09 13:31:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:28 devstack sudo[85099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c Apr 09 13:31:28 devstack sudo[85099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:29 devstack sudo[85099]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c" returned: 0 in 0.612s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.009s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:29 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ef1915b0-70e1-406b-8c22-617b85b0d80a tempest-SnapshotsActionsTest-1813267922 None] Create snapshot completed successfully Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-7a018648-a7b8-4fb0-9e5a-37a2659b263c-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-7a018648-a7b8-4fb0-9e5a-37a2659b263c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Acquiring lock "cinder-quobyte-7a018648-a7b8-4fb0-9e5a-37a2659b263c" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-7a018648-a7b8-4fb0-9e5a-37a2659b263c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Deleting offline snapshot 7a018648-a7b8-4fb0-9e5a-37a2659b263c of volume ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] snapshot_file for this snap is: volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f472157b-2e89-40ad-838b-06feeca7807b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:29 devstack sudo[85102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c Apr 09 13:31:29 devstack sudo[85102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:30 devstack sudo[85102]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c" returned: 0 in 0.777s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:30 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97808a1-6f81-47b5-86ec-43ce329d4a5d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:30 devstack sudo[85131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:31:30 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:31 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.713s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:31 devstack sudo[85137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c Apr 09 13:31:31 devstack sudo[85137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Flow 'volume_create_manager' (b699225c-3aa7-4b40-8932-2fe9493b7889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4299360-6e9e-4ba0-b2d4-12ec24647a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4299360-6e9e-4ba0-b2d4-12ec24647a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1343443462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28986d7e-db26-4357-88d2-19208129b8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720474d227bc4326b8e77229b2313da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:32Z,use_quota=True,user_id='9857e4a4dd4c4829b7aa0248b1141dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2e8af14-8074-4c45-b6f5-d80762dac162),volume_type_id=a2e8af14-8074-4c45-b6f5-d80762dac162)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387e670b-8b53-479a-8449-ee3a628b4588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387e670b-8b53-479a-8449-ee3a628b4588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e94824d-751b-499b-870f-8cc43019318e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e94824d-751b-499b-870f-8cc43019318e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28986d7e-db26-4357-88d2-19208129b8d3', 'volume_name': 'volume-28986d7e-db26-4357-88d2-19208129b8d3', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa41aafc-668b-49cb-ac3c-11e821a5a9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa41aafc-668b-49cb-ac3c-11e821a5a9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c7380f-e3b2-40dc-bdf5-14268e1d2662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:31 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Volume 28986d7e-db26-4357-88d2-19208129b8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28986d7e-db26-4357-88d2-19208129b8d3', 'volume_size': 1} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1343443462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28986d7e-db26-4357-88d2-19208129b8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='720474d227bc4326b8e77229b2313da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:32Z,use_quota=True,user_id='9857e4a4dd4c4829b7aa0248b1141dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2e8af14-8074-4c45-b6f5-d80762dac162),volume_type_id=a2e8af14-8074-4c45-b6f5-d80762dac162)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Creating volume 28986d7e-db26-4357-88d2-19208129b8d3 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:31:31 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:31 devstack sudo[85142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3 1073741824 Apr 09 13:31:31 devstack sudo[85142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:31 devstack sudo[85137]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c" returned: 0 in 0.678s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:31 devstack sudo[85145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c Apr 09 13:31:31 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:32 devstack sudo[85142]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3 1073741824" returned: 0 in 0.736s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:32 devstack sudo[85171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3 Apr 09 13:31:32 devstack sudo[85171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:32 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.7a018648-a7b8-4fb0-9e5a-37a2659b263c" returned: 0 in 0.624s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-7a018648-a7b8-4fb0-9e5a-37a2659b263c" released by "_delete_snapshot" :: held 2.880s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" released by "delete_snapshot" :: held 2.896s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:32 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Created reservations ['842e811c-21ae-43bc-a47a-a34f6fff7758', '58778997-7d65-48ed-98be-d8bd4274dfce', 'f0011cb3-95b4-47bd-b224-22c13cdee457', 'd96cc7fe-8e8a-44e4-a269-13c43bac2315'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:32 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Delete snapshot completed successfully. Apr 09 13:31:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e79bb8c0-4347-4a52-b71b-2dfd6dec11da tempest-SnapshotsActionsTest-811376478 None] Lock "cinder-7a018648-a7b8-4fb0-9e5a-37a2659b263c-delete_snapshot" released by "delete_snapshot" :: held 3.000s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:33 devstack sudo[85171]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3" returned: 0 in 0.546s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c7380f-e3b2-40dc-bdf5-14268e1d2662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28986d7e-db26-4357-88d2-19208129b8d3', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a18065-e459-432b-964b-2f4984b01af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:33 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Volume volume-28986d7e-db26-4357-88d2-19208129b8d3 (28986d7e-db26-4357-88d2-19208129b8d3): created successfully Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a18065-e459-432b-964b-2f4984b01af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Flow 'volume_create_manager' (b699225c-3aa7-4b40-8932-2fe9493b7889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:31:33 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-34f39cae-598d-4bc2-9324-eafbcbf547b0 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Created volume successfully. Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "cinder-84fcadfe-fedc-425b-ab5b-f1bd95e4138a-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Lock "cinder-84fcadfe-fedc-425b-ab5b-f1bd95e4138a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "cinder-quobyte-84fcadfe-fedc-425b-ab5b-f1bd95e4138a" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Lock "cinder-quobyte-84fcadfe-fedc-425b-ab5b-f1bd95e4138a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Deleting offline snapshot 84fcadfe-fedc-425b-ab5b-f1bd95e4138a of volume ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] snapshot_file for this snap is: volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4a3bcb-c182-4557-97ff-ca5b05edc54b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo_service.periodic_task [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82346) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:33 devstack sudo[85175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:31:33 devstack sudo[85175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:33 devstack sudo[85176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:31:33 devstack sudo[85176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:33 devstack sudo[85175]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.659s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:33 devstack sudo[85176]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.608s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c23aac-6d74-49a8-bcbc-6c7780a23ab0]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:34 devstack sudo[85195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 Apr 09 13:31:34 devstack sudo[85195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34c3d04c-6b18-4ad0-8d16-abe06d47c7db tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34c3d04c-6b18-4ad0-8d16-abe06d47c7db tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34c3d04c-6b18-4ad0-8d16-abe06d47c7db tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34c3d04c-6b18-4ad0-8d16-abe06d47c7db tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34c3d04c-6b18-4ad0-8d16-abe06d47c7db tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-34c3d04c-6b18-4ad0-8d16-abe06d47c7db tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:34 devstack sudo[85198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:31:34 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:34 devstack sudo[85195]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8" returned: 0 in 0.679s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:34 devstack sudo[85204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:31:34 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:34 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-34c3d04c-6b18-4ad0-8d16-abe06d47c7db tempest-VolumeRetypeWithoutMigrationTest-52304462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.529s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:34 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-34c3d04c-6b18-4ad0-8d16-abe06d47c7db tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:31:34 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-34c3d04c-6b18-4ad0-8d16-abe06d47c7db tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Retype volume completed successfully. Apr 09 13:31:35 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.547s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:35 devstack sudo[85210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a Apr 09 13:31:35 devstack sudo[85210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Acquiring lock "cinder-28986d7e-db26-4357-88d2-19208129b8d3-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "cinder-28986d7e-db26-4357-88d2-19208129b8d3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Acquiring lock "cinder-quobyte-28986d7e-db26-4357-88d2-19208129b8d3" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "cinder-quobyte-28986d7e-db26-4357-88d2-19208129b8d3" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d249ad-fa1a-4970-9ef4-a7e585164c33]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:35 devstack sudo[85213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3 Apr 09 13:31:35 devstack sudo[85213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:35 devstack sudo[85210]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8.84fcadfe-fedc-425b-ab5b-f1bd95e4138a" returned: 0 in 0.629s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Lock "cinder-quobyte-84fcadfe-fedc-425b-ab5b-f1bd95e4138a" released by "_delete_snapshot" :: held 2.592s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" released by "delete_snapshot" :: held 2.607s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Created reservations ['ce20981c-97db-4375-8967-df0fac83aadf', '490d09e2-9788-485f-bb4b-dc0ddf896568', 'f1aacc33-b56b-4c36-ae49-494b1a09d378', '4c3e46bd-3055-4de4-b7b4-619144acdbe3'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Delete snapshot completed successfully. Apr 09 13:31:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-acb83771-28f4-4c5f-9d44-30bff643be64 tempest-SnapshotsActionsTest-1813267922 None] Lock "cinder-84fcadfe-fedc-425b-ab5b-f1bd95e4138a-delete_snapshot" released by "delete_snapshot" :: held 2.712s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:36 devstack sudo[85213]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3" returned: 0 in 0.652s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:36 devstack sudo[85220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3 Apr 09 13:31:36 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "cinder-ec801c87-dc5a-4700-b260-2b4a3c703ee8-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Lock "cinder-ec801c87-dc5a-4700-b260-2b4a3c703ee8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:36 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[985eb9d7-6d5c-4223-bfd8-ad906624eab1]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:36 devstack sudo[85222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 Apr 09 13:31:36 devstack sudo[85222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:36 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-28986d7e-db26-4357-88d2-19208129b8d3" returned: 0 in 0.670s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "cinder-quobyte-28986d7e-db26-4357-88d2-19208129b8d3" released by "delete_volume" :: held 1.354s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:36 devstack cinder-volume[82346]: WARNING cinder.quota [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:31:36 devstack cinder-volume[82346]: WARNING cinder.quota [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:31:36 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Created reservations ['ed43cd1f-f16d-48d8-a298-9637985cec8b', '38fc2aa7-64b3-4e3a-92f8-8df7b97464df', 'fe7f2161-ac7f-481a-8515-cc108be37cea', 'b347d3c6-09dd-4ddf-901e-5fdb8b936ce0'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:37 devstack sudo[85250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:31:37 devstack sudo[85250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:37 devstack sudo[85222]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8" returned: 0 in 0.905s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:37 devstack sudo[85256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8 Apr 09 13:31:37 devstack sudo[85256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:38 devstack sudo[85256]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ec801c87-dc5a-4700-b260-2b4a3c703ee8" returned: 0 in 0.869s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Lock "cinder-quobyte-ec801c87-dc5a-4700-b260-2b4a3c703ee8" released by "delete_volume" :: held 1.816s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:38 devstack sudo[85250]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Created reservations ['f2226f58-3ed5-4d62-a9ed-b3af05e45b48', 'e6c0920c-8ade-4f94-983d-8938c98841b6', '45e2b2b8-079e-4764-9799-90665acfd161', '9b011bf2-ebc2-4a0c-96ba-e1a588d55313'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 1.401s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:31:38 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Deleted volume successfully. Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bbbb9467-1495-45ff-a268-a6031f9089b7 tempest-VolumeRetypeWithoutMigrationTest-52304462 None] Lock "cinder-28986d7e-db26-4357-88d2-19208129b8d3-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:38 devstack sudo[85263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:31:38 devstack sudo[85263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:39 devstack sudo[85263]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 1.076s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:39 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:31:39 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Deleted volume successfully. Apr 09 13:31:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-10fb9ad3-3950-4a0d-a51f-dd791f160276 tempest-SnapshotsActionsTest-1813267922 None] Lock "cinder-ec801c87-dc5a-4700-b260-2b4a3c703ee8-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Flow 'volume_create_manager' (10dc19d3-00c9-4179-b6ce-fcb75078fd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e86e7b-5572-4e89-8145-d6878016d1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e86e7b-5572-4e89-8145-d6878016d1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1378603911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f56443-7639-4b91-a6a7-1d6cd45e785e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0749a7987556462abc1ef8d2cf8a670f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:45Z,use_quota=True,user_id='528a5538cc3043f980bdadbfcdab82be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca17691-2126-4b63-a01e-8ed382559d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca17691-2126-4b63-a01e-8ed382559d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff66658-120e-4157-9ffb-6b3e0e15773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff66658-120e-4157-9ffb-6b3e0e15773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f56443-7639-4b91-a6a7-1d6cd45e785e', 'volume_name': 'volume-36f56443-7639-4b91-a6a7-1d6cd45e785e', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358ddfd4-093b-4ebe-b45d-b7a15ffcd887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358ddfd4-093b-4ebe-b45d-b7a15ffcd887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4b2df9-3cf8-4453-bc59-6f0102870844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:45 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Volume 36f56443-7639-4b91-a6a7-1d6cd45e785e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f56443-7639-4b91-a6a7-1d6cd45e785e', 'volume_size': 1} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1378603911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f56443-7639-4b91-a6a7-1d6cd45e785e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0749a7987556462abc1ef8d2cf8a670f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:45Z,use_quota=True,user_id='528a5538cc3043f980bdadbfcdab82be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Creating volume 36f56443-7639-4b91-a6a7-1d6cd45e785e {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:31:45 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:31:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:45 devstack sudo[85320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e 1073741824 Apr 09 13:31:45 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:46 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e 1073741824" returned: 0 in 0.941s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:46 devstack sudo[85333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e Apr 09 13:31:46 devstack sudo[85333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:47 devstack sudo[85333]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e" returned: 0 in 0.808s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:47 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:31:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4b2df9-3cf8-4453-bc59-6f0102870844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f56443-7639-4b91-a6a7-1d6cd45e785e', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773b85e7-e5c9-4c5f-bb65-e329dca171e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:47 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Volume volume-36f56443-7639-4b91-a6a7-1d6cd45e785e (36f56443-7639-4b91-a6a7-1d6cd45e785e): created successfully Apr 09 13:31:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773b85e7-e5c9-4c5f-bb65-e329dca171e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Flow 'volume_create_manager' (10dc19d3-00c9-4179-b6ce-fcb75078fd5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:31:47 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-34f7f502-e017-49fa-9045-0dc4018d32f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Created volume successfully. Apr 09 13:31:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:48 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Creating offline snapshot c037063e-2b63-4538-afdc-da92cae51d0f of volume 36f56443-7639-4b91-a6a7-1d6cd45e785e {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:31:48 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a5a834-ab3c-4e99-8ff5-7fe17212ddea]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:48 devstack sudo[85363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e Apr 09 13:31:48 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:49 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e" returned: 0 in 0.708s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:49 devstack sudo[85369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f 1G Apr 09 13:31:49 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:50 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f 1G" returned: 0 in 0.696s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f56443-7639-4b91-a6a7-1d6cd45e785e -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:50 devstack sudo[85376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f56443-7639-4b91-a6a7-1d6cd45e785e -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f Apr 09 13:31:50 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:50 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-e0ea46cf-3cde-48d4-9a8f-62b63f6d06b5 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Terminate volume connection completed successfully. Apr 09 13:31:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-e0ea46cf-3cde-48d4-9a8f-62b63f6d06b5 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Deleting attachment e7afe12a-f69f-4bf6-94f3-92fbcc99ab82. {{(pid=82346) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 09 13:31:50 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36f56443-7639-4b91-a6a7-1d6cd45e785e -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f" returned: 0 in 0.708s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:50 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f is being set with open permissions: ugo+rw Apr 09 13:31:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:50 devstack sudo[85381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f Apr 09 13:31:50 devstack sudo[85381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:50 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "cinder-522094e1-e2ac-4253-875d-931ee6860729-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:50 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "cinder-522094e1-e2ac-4253-875d-931ee6860729-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "cinder-quobyte-522094e1-e2ac-4253-875d-931ee6860729" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "cinder-quobyte-522094e1-e2ac-4253-875d-931ee6860729" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:51 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d1ecf9-0421-4b68-9983-d093aa54e981]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:51 devstack sudo[85381]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f" returned: 0 in 0.572s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:51 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 Apr 09 13:31:51 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:51 devstack sudo[85386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.info Apr 09 13:31:51 devstack sudo[85386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:52 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729" returned: 0 in 0.876s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:52 devstack sudo[85386]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.info" returned: 0 in 0.743s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:52 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.info is being set with open permissions: ugo+rw Apr 09 13:31:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:52 devstack sudo[85430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.info Apr 09 13:31:52 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:52 devstack sudo[85429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 Apr 09 13:31:52 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:52 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729" returned: 1 in 0.529s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:31:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:52 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.info" returned: 0 in 0.524s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:52 devstack sudo[85437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729 Apr 09 13:31:52 devstack sudo[85437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.040s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:52 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-85747b9b-d427-4ba8-9447-4432a921ba5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Create snapshot completed successfully Apr 09 13:31:53 devstack sudo[85437]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Acquiring lock "cinder-c037063e-2b63-4538-afdc-da92cae51d0f-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-522094e1-e2ac-4253-875d-931ee6860729" returned: 0 in 0.574s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "cinder-quobyte-522094e1-e2ac-4253-875d-931ee6860729" released by "delete_volume" :: held 2.057s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "cinder-c037063e-2b63-4538-afdc-da92cae51d0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Acquiring lock "cinder-quobyte-36f56443-7639-4b91-a6a7-1d6cd45e785e" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "cinder-quobyte-36f56443-7639-4b91-a6a7-1d6cd45e785e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Acquiring lock "cinder-quobyte-c037063e-2b63-4538-afdc-da92cae51d0f" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "cinder-quobyte-c037063e-2b63-4538-afdc-da92cae51d0f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Deleting offline snapshot c037063e-2b63-4538-afdc-da92cae51d0f of volume 36f56443-7639-4b91-a6a7-1d6cd45e785e {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] snapshot_file for this snap is: volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c74f999-5b21-412c-b975-9e5dba63cc47]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.quota [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Created reservations ['0e5748d9-c46b-48ee-9376-0ed318638535', '5343609f-d137-456e-b5fc-70d2780eaf55', '6f64f392-7c8c-4851-b2c2-5251df1b2953', 'e7c44bf3-dcfb-448e-9414-e4828766b7a3'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:53 devstack sudo[85441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f Apr 09 13:31:53 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:53 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:31:53 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:53 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f" returned: 0 in 0.546s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36f56443-7639-4b91-a6a7-1d6cd45e785e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6d7c04-9c34-4c2b-bb56-bf1683cee567]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:53 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.553s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.manager [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:31:53 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Deleted volume successfully. Apr 09 13:31:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-64be3923-3356-4bc2-a170-e6d1f02e8062 req-f07dfeff-1c1e-4a28-9436-7a55b4e90590 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "cinder-522094e1-e2ac-4253-875d-931ee6860729-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:53 devstack sudo[85449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e Apr 09 13:31:53 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:54 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e" returned: 0 in 0.606s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:54 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f Apr 09 13:31:54 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:54 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f" returned: 0 in 0.585s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:55 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f Apr 09 13:31:55 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:55 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e.c037063e-2b63-4538-afdc-da92cae51d0f" returned: 0 in 0.545s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:55 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "cinder-quobyte-c037063e-2b63-4538-afdc-da92cae51d0f" released by "_delete_snapshot" :: held 2.366s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:55 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "cinder-quobyte-36f56443-7639-4b91-a6a7-1d6cd45e785e" released by "delete_snapshot" :: held 2.387s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:55 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Created reservations ['20abafbb-305a-4261-a51d-1b884532ac9a', '35d9df01-46de-451d-b473-a4cfc87f7705', '01384330-6c0c-439f-af41-5d8b13c438e7', '4499b152-91cd-46fe-aa7b-94a24e110d85'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:55 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Delete snapshot completed successfully. Apr 09 13:31:55 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ccf435c5-6480-4400-8935-9b50159b9988 tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "cinder-c037063e-2b63-4538-afdc-da92cae51d0f-delete_snapshot" released by "delete_snapshot" :: held 2.496s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:56 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Acquiring lock "cinder-36f56443-7639-4b91-a6a7-1d6cd45e785e-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:56 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "cinder-36f56443-7639-4b91-a6a7-1d6cd45e785e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:56 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Acquiring lock "cinder-quobyte-36f56443-7639-4b91-a6a7-1d6cd45e785e" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:31:56 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "cinder-quobyte-36f56443-7639-4b91-a6a7-1d6cd45e785e" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:31:56 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[334933e5-af59-4aa3-8003-a7f1759d836e]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:31:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:56 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e Apr 09 13:31:56 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:57 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e" returned: 0 in 0.630s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:57 devstack sudo[85496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e Apr 09 13:31:57 devstack sudo[85496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:57 devstack sudo[85496]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-36f56443-7639-4b91-a6a7-1d6cd45e785e" returned: 0 in 0.566s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "cinder-quobyte-36f56443-7639-4b91-a6a7-1d6cd45e785e" released by "delete_volume" :: held 1.247s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Created reservations ['baeea9f9-de20-499e-9ad9-2f5cb58b8255', 'b9e930ca-6cb3-4bc1-9a85-869f703678ea', '20eb11e5-e551-40ba-bbca-705767114037', '588ce02c-1b65-4b12-9c05-7a9e04a5d438'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:57 devstack sudo[85500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:31:57 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Flow 'volume_create_manager' (d7ee0c9e-5329-4244-811e-e164fa87646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f3aca8-2ed3-4ea1-8f3a-3d994174a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f3aca8-2ed3-4ea1-8f3a-3d994174a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-732245311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17375ff3-9838-4e20-a787-b7b982ec4e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa18982d79a4708a998181c6429f987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:58Z,use_quota=True,user_id='6bff77318a2f41b18fd5e2fd733752f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1a61f3-5eb1-4f55-b571-c5f4bb9833fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1a61f3-5eb1-4f55-b571-c5f4bb9833fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e27da8d-bca2-4be4-8d26-76edca8af81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e27da8d-bca2-4be4-8d26-76edca8af81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17375ff3-9838-4e20-a787-b7b982ec4e7c', 'volume_name': 'volume-17375ff3-9838-4e20-a787-b7b982ec4e7c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933ed193-f06e-4080-af2d-fa9eeac283e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933ed193-f06e-4080-af2d-fa9eeac283e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d69fa28-2a61-4481-8015-a6096e2ff379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:57 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Volume 17375ff3-9838-4e20-a787-b7b982ec4e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17375ff3-9838-4e20-a787-b7b982ec4e7c', 'volume_size': 1} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-732245311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17375ff3-9838-4e20-a787-b7b982ec4e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa18982d79a4708a998181c6429f987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:31:58Z,use_quota=True,user_id='6bff77318a2f41b18fd5e2fd733752f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Creating volume 17375ff3-9838-4e20-a787-b7b982ec4e7c {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:31:57 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:31:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:57 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c 1073741824 Apr 09 13:31:57 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:58 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.497s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:58 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:31:58 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Deleted volume successfully. Apr 09 13:31:58 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bce74127-40f9-4367-b1f4-d06ae0ead99a tempest-VolumeSnapshotQuotasNegativeTestJSON-1262912518 None] Lock "cinder-36f56443-7639-4b91-a6a7-1d6cd45e785e-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:31:58 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c 1073741824" returned: 0 in 0.645s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:31:58 devstack sudo[85519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c Apr 09 13:31:58 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:31:59 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root Apr 09 13:31:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c" returned: 0 in 0.610s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:31:59 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:31:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:31:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d69fa28-2a61-4481-8015-a6096e2ff379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17375ff3-9838-4e20-a787-b7b982ec4e7c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0c1735-8a59-4a13-8bfc-73b8d712e9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:31:59 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Volume volume-17375ff3-9838-4e20-a787-b7b982ec4e7c (17375ff3-9838-4e20-a787-b7b982ec4e7c): created successfully Apr 09 13:31:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0c1735-8a59-4a13-8bfc-73b8d712e9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:31:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Flow 'volume_create_manager' (d7ee0c9e-5329-4244-811e-e164fa87646f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:31:59 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ed45ec7c-bc34-4561-871c-45a995773d0a tempest-VolumesServicesTestJSON-1726654746 None] Created volume successfully. Apr 09 13:32:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Acquiring lock "cinder-17375ff3-9838-4e20-a787-b7b982ec4e7c-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Lock "cinder-17375ff3-9838-4e20-a787-b7b982ec4e7c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Acquiring lock "cinder-quobyte-17375ff3-9838-4e20-a787-b7b982ec4e7c" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Lock "cinder-quobyte-17375ff3-9838-4e20-a787-b7b982ec4e7c" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:00 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aadc9b-b996-4dc5-82e4-3577cc9d279b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:00 devstack sudo[85528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c Apr 09 13:32:00 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:00 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c" returned: 0 in 0.529s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:00 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c Apr 09 13:32:00 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:01 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-17375ff3-9838-4e20-a787-b7b982ec4e7c" returned: 0 in 0.517s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Lock "cinder-quobyte-17375ff3-9838-4e20-a787-b7b982ec4e7c" released by "delete_volume" :: held 1.070s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Created reservations ['242734be-6bdb-449a-82bc-2781b4312aa6', '6d347699-b520-472b-9f03-bb909a6f9a3e', '2b3dd7cc-0bba-4305-892c-5f924457a88b', '7a2cd7d3-5b7d-4a21-91ac-052b22b63a44'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:01 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:01 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:01 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.555s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:01 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Deleted volume successfully. Apr 09 13:32:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8f3c9e1a-b900-444f-869f-89902bfbb7a7 tempest-VolumesServicesTestJSON-1726654746 None] Lock "cinder-17375ff3-9838-4e20-a787-b7b982ec4e7c-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Flow 'volume_create_manager' (b5fda30e-6448-40c2-9d86-c1c1ea4a62de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a929fca4-39b5-4607-bc89-b966a771bb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a929fca4-39b5-4607-bc89-b966a771bb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-889372749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f618244-9cd3-411e-bf67-f5a6e1f7fcbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b11c9f54fe24ea9a3a5e32945790c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:03Z,use_quota=True,user_id='258c180764a145ccbf89d34a7cadf733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bdff110-3761-42c0-897f-59b3e6f7659a),volume_type_id=2bdff110-3761-42c0-897f-59b3e6f7659a)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5edd1eb-219d-453a-8782-463461785825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5edd1eb-219d-453a-8782-463461785825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d1d8d1-dbaa-408a-be29-c9e057a1be91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d1d8d1-dbaa-408a-be29-c9e057a1be91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f618244-9cd3-411e-bf67-f5a6e1f7fcbd', 'volume_name': 'volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1888a0d-73fc-42dc-8290-d2ffb73c8707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1888a0d-73fc-42dc-8290-d2ffb73c8707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fabd434-b654-4fcb-bb08-6b269f0acfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:03 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Volume 5f618244-9cd3-411e-bf67-f5a6e1f7fcbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd', 'volume_size': 1} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-889372749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f618244-9cd3-411e-bf67-f5a6e1f7fcbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b11c9f54fe24ea9a3a5e32945790c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:03Z,use_quota=True,user_id='258c180764a145ccbf89d34a7cadf733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bdff110-3761-42c0-897f-59b3e6f7659a),volume_type_id=2bdff110-3761-42c0-897f-59b3e6f7659a)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Creating volume 5f618244-9cd3-411e-bf67-f5a6e1f7fcbd {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:03 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:32:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:03 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd 1073741824 Apr 09 13:32:03 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:04 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd 1073741824" returned: 0 in 0.996s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:04 devstack sudo[85612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd Apr 09 13:32:04 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:05 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-8549f6c2-ff63-43ae-ab31-372c43ee89af tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Terminate volume connection completed successfully. Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-8549f6c2-ff63-43ae-ab31-372c43ee89af tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Deleting attachment 4698f354-8e85-4447-852c-0947e7ceba04. {{(pid=82346) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 09 13:32:05 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd" returned: 0 in 0.650s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fabd434-b654-4fcb-bb08-6b269f0acfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8386c9e-fefc-40be-9401-1287c5441f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:05 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Volume volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd (5f618244-9cd3-411e-bf67-f5a6e1f7fcbd): created successfully Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8386c9e-fefc-40be-9401-1287c5441f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Flow 'volume_create_manager' (b5fda30e-6448-40c2-9d86-c1c1ea4a62de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:05 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-8bccf904-8a6a-4a57-bd16-f63da3837f40 tempest-VolumeTypesAccessTest-1884997069 None] Created volume successfully. Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Acquiring lock "cinder-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Lock "cinder-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Acquiring lock "cinder-quobyte-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Lock "cinder-quobyte-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd" acquired by "delete_volume" :: waited 0.019s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "cinder-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe908c3d-1847-4bd6-b675-67ad8c62fd3b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "cinder-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "cinder-quobyte-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "cinder-quobyte-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:05 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd20dce-f4be-46d2-8d06-0b1ebeb2727b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:06 devstack sudo[85619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd Apr 09 13:32:06 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:06 devstack sudo[85621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b Apr 09 13:32:06 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:06 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd" returned: 0 in 0.646s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:06 devstack sudo[85626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd Apr 09 13:32:06 devstack sudo[85626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:06 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b" returned: 0 in 0.762s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:06 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b Apr 09 13:32:06 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Flow 'volume_create_manager' (d5dcc984-df95-485a-a656-76042b172faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62104b3b-4764-4f57-9ad1-39f446aead4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62104b3b-4764-4f57-9ad1-39f446aead4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2024825560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaed389-ecd0-4915-8808-147b6cb300b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cacc61d5d8564b3f8939e87fa9eba08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:07Z,use_quota=True,user_id='473918a2beed4bba9260d2292d778ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63dbffd0-2949-4771-952d-55d2f55164c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63dbffd0-2949-4771-952d-55d2f55164c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2917f9-f8dc-451c-84d1-286930cb59d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.image.glance [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Creating Keystone auth plugin from conf {{(pid=82346) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 13:32:07 devstack sudo[85626]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd" returned: 0 in 0.714s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Lock "cinder-quobyte-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd" released by "delete_volume" :: held 1.420s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:07 devstack cinder-volume[82346]: WARNING cinder.quota [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-851918725 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-851918725, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:32:07 devstack cinder-volume[82346]: WARNING cinder.quota [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-851918725 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-851918725, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2917f9-f8dc-451c-84d1-286930cb59d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'acaed389-ecd0-4915-8808-147b6cb300b2', 'volume_name': 'volume-acaed389-ecd0-4915-8808-147b6cb300b2', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e6268c-a72b-47bb-9ab5-4ffe42e78330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e6268c-a72b-47bb-9ab5-4ffe42e78330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae726a9c-89e5-45e2-945c-18cca8a53c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:07 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Volume acaed389-ecd0-4915-8808-147b6cb300b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-acaed389-ecd0-4915-8808-147b6cb300b2', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Trying to clone acaed389-ecd0-4915-8808-147b6cb300b2 from image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e at location (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]). {{(pid=82346) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Created reservations ['d59d8f59-a538-4e77-b1f0-2b6d09123ce2', 'e6787ba4-e9ef-454c-9426-d81fb9b6f6e5', 'db5ac874-4ad3-4f0d-aeba-f0031334ad5e', 'a2c84c64-3c5d-4374-8f20-1dadd54c332d'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:07 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b" returned: 0 in 0.846s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:07 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:07 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "cinder-quobyte-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b" released by "delete_volume" :: held 1.653s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 13:32:07 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Image download 20.69 MB at 20.69 MB/s Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (579d4cfa-3d23-4875-9b7e-5f3be2f8d59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf8021b-51f2-445e-a1f7-08a8fcf93fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf8021b-51f2-445e-a1f7-08a8fcf93fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360765739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a24422-a674-4d6f-b0d8-0de3d2bee3a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:08Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bb7ff4-faca-4be4-81f9-d62e91b7835c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bb7ff4-faca-4be4-81f9-d62e91b7835c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f24e9e-0f27-4120-93e0-5ee07a1c8290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f24e9e-0f27-4120-93e0-5ee07a1c8290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a24422-a674-4d6f-b0d8-0de3d2bee3a8', 'volume_name': 'volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d4ce7e-72fa-4b9b-bd8c-fa2b7292912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d4ce7e-72fa-4b9b-bd8c-fa2b7292912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025cfbbc-f9f1-4c29-9c2b-f15ddf554d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:07 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Volume c0a24422-a674-4d6f-b0d8-0de3d2bee3a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8', 'volume_size': 1} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360765739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a24422-a674-4d6f-b0d8-0de3d2bee3a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:08Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Creating volume c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:07 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.quota [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Created reservations ['f22bdf28-6178-41d6-8fc6-7737a527d4af', '596f4f09-3902-48b8-87b9-069125741724', '252a187d-275f-47ac-969a-267c54bc1a90', '66f4a0a2-2e58-4fa3-96d3-72d008425a68'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:07 devstack sudo[85639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 1073741824 Apr 09 13:32:07 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1ad5e8-51c3-4681-ac34-a5d4b9430c37]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:07 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:07 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:07 devstack sudo[85641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD Apr 09 13:32:07 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:08 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.603s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:08 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Deleted volume successfully. Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9a697010-afa2-438f-95db-730b01bc56c0 tempest-VolumeTypesAccessTest-1884997069 None] Lock "cinder-5f618244-9cd3-411e-bf67-f5a6e1f7fcbd-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:08 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Temporary image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e is fetched for user 473918a2beed4bba9260d2292d778ed9. {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 13:32:08 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 1073741824" returned: 0 in 0.909s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0369baf8-8dbf-4f7f-8182-53fc1d6a6baf]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:08 devstack sudo[85653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 Apr 09 13:32:08 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:08 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.950s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG cinder.manager [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:08 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Deleted volume successfully. Apr 09 13:32:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-5095c47f-4483-4cfe-9f8e-c4271742d8ca req-d14076ab-c511-47c0-b177-ba4559874799 tempest-ServerBootFromVolumeStableRescueTest-1708719450 None] Lock "cinder-ab57e57d-4cd6-4a81-9c25-a1e093f72b5b-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:08 devstack sudo[85654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD Apr 09 13:32:08 devstack sudo[85654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:09 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8" returned: 0 in 0.624s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025cfbbc-f9f1-4c29-9c2b-f15ddf554d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f96323-8a3b-4853-b6a8-8b61f26631ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:09 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Volume volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 (c0a24422-a674-4d6f-b0d8-0de3d2bee3a8): created successfully Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f96323-8a3b-4853-b6a8-8b61f26631ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (579d4cfa-3d23-4875-9b7e-5f3be2f8d59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:09 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-07ce3486-9dd0-4cda-81b9-4259dbe519f7 tempest-VolumesActionsTest-870928099 None] Created volume successfully. Apr 09 13:32:09 devstack sudo[85654]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2024825560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaed389-ecd0-4915-8808-147b6cb300b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cacc61d5d8564b3f8939e87fa9eba08f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:07Z,use_quota=True,user_id='473918a2beed4bba9260d2292d778ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Creating volume acaed389-ecd0-4915-8808-147b6cb300b2 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:09 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:09 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 1073741824 Apr 09 13:32:09 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-623dd3f4-5e52-4a75-9d2c-03a6411f1d79 tempest-VolumesActionsTest-870928099 None] Acquiring lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8" by "attach_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-623dd3f4-5e52-4a75-9d2c-03a6411f1d79 tempest-VolumesActionsTest-870928099 None] Lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8" acquired by "attach_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:09 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-623dd3f4-5e52-4a75-9d2c-03a6411f1d79 tempest-VolumesActionsTest-870928099 None] Attaching volume c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 to instance 516583df-0f97-43af-86f3-544249324391 at mountpoint /dev/vdb on host None. Apr 09 13:32:09 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-623dd3f4-5e52-4a75-9d2c-03a6411f1d79 tempest-VolumesActionsTest-870928099 None] Attach volume completed successfully. Apr 09 13:32:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-623dd3f4-5e52-4a75-9d2c-03a6411f1d79 tempest-VolumesActionsTest-870928099 None] Lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8" released by "attach_volume" :: held 0.117s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:10 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 1073741824" returned: 0 in 0.939s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:10 devstack sudo[85674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 Apr 09 13:32:10 devstack sudo[85674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:10 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-46bb5669-127e-46eb-9736-fefdddaf6174 tempest-VolumesActionsTest-1368961385 None] Terminate volume connection completed successfully. Apr 09 13:32:11 devstack sudo[85674]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2" returned: 0 in 0.715s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:32:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:11 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Attempting download of eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e ((None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}])) to volume acaed389-ecd0-4915-8808-147b6cb300b2. {{(pid=82346) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 13:32:11 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb25cfda-62e0-4a58-90d4-330a7e51591a]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_1g2u4x3g {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:11 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_1g2u4x3g Apr 09 13:32:11 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-46bb5669-127e-46eb-9736-fefdddaf6174 tempest-VolumesActionsTest-1368961385 None] Acquiring lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8-detach_volume" by "detach_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-46bb5669-127e-46eb-9736-fefdddaf6174 tempest-VolumesActionsTest-1368961385 None] Lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:11 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-46bb5669-127e-46eb-9736-fefdddaf6174 tempest-VolumesActionsTest-1368961385 None] Detaching volume c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 from instance 516583df-0f97-43af-86f3-544249324391. Apr 09 13:32:11 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-46bb5669-127e-46eb-9736-fefdddaf6174 tempest-VolumesActionsTest-1368961385 None] Detach volume completed successfully. Apr 09 13:32:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-46bb5669-127e-46eb-9736-fefdddaf6174 tempest-VolumesActionsTest-1368961385 None] Lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:11 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_1g2u4x3g" returned: 0 in 0.559s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_1g2u4x3g {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:11 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_1g2u4x3g Apr 09 13:32:11 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51eb3b51-b3d4-416d-940d-95b84438b90c tempest-VolumesActionsTest-870928099 None] Acquiring lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8-detach_volume" by "detach_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51eb3b51-b3d4-416d-940d-95b84438b90c tempest-VolumesActionsTest-870928099 None] Lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:12 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-51eb3b51-b3d4-416d-940d-95b84438b90c tempest-VolumesActionsTest-870928099 None] Volume detach called, but volume not attached. Apr 09 13:32:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51eb3b51-b3d4-416d-940d-95b84438b90c tempest-VolumesActionsTest-870928099 None] Lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:12 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_1g2u4x3g" returned: 1 in 0.718s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_1g2u4x3g' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:32:12 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c5a710-ec8f-42ae-a067-edbb65dd9803]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:12 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD Apr 09 13:32:12 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Acquiring lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Acquiring lock "cinder-quobyte-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Lock "cinder-quobyte-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8" acquired by "delete_volume" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:13 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD" returned: 0 in 0.623s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:13 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e was qcow2, converting to raw {{(pid=82346) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 13:32:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:13 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed35420-1e32-4f5d-9988-294ce83df954]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:13 devstack sudo[85711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 Apr 09 13:32:13 devstack sudo[85711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:13 devstack sudo[85712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 Apr 09 13:32:13 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:14 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8" returned: 0 in 0.856s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:14 devstack sudo[85723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8 Apr 09 13:32:14 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:14 devstack sudo[85711]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2" returned: 0 in 1.291s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_43i3x32gdevstack@QuobyteHD, size 112.00 MB, duration 1.29 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:32:14 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Converted 112.00 MB image at 86.67 MB/s Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:14 devstack sudo[85725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 1G Apr 09 13:32:14 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:14 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8" returned: 0 in 0.619s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Lock "cinder-quobyte-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8" released by "delete_volume" :: held 1.553s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Created reservations ['98a7d995-4045-4ab1-bdc5-7b442472a147', '61e6dcc3-2541-4cf3-91f4-47e6e38e59d2', '27dea79c-f314-456a-9ed3-a2917edcfbb3', '2ad1fa9f-6b08-4f82-8c40-4b7634a2f70d'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:14 devstack sudo[85728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:14 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:15 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 1G" returned: 0 in 0.602s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:15 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e52f14-02f6-453c-8acd-0ba0c49ce245]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:15 devstack sudo[85733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 Apr 09 13:32:15 devstack sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:15 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.591s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:15 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:15 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Deleted volume successfully. Apr 09 13:32:15 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c8fa2741-14c5-4867-810b-083319f4f4ad tempest-VolumesActionsTest-870928099 None] Lock "cinder-c0a24422-a674-4d6f-b0d8-0de3d2bee3a8-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:15 devstack sudo[85733]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2" returned: 0 in 0.739s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:15 devstack sudo[85740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 Apr 09 13:32:15 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:16 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2" returned: 1 in 0.706s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:32:16 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Downloaded image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e ((None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}])) to volume acaed389-ecd0-4915-8808-147b6cb300b2 successfully. {{(pid=82346) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 13:32:16 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Temporary image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e for user 473918a2beed4bba9260d2292d778ed9 is deleted. {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 13:32:16 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Marking volume acaed389-ecd0-4915-8808-147b6cb300b2 as bootable. {{(pid=82346) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 13:32:16 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Copying metadata from image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e to acaed389-ecd0-4915-8808-147b6cb300b2. {{(pid=82346) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 13:32:16 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Creating volume glance metadata for volume acaed389-ecd0-4915-8808-147b6cb300b2 backed by image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82346) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 13:32:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae726a9c-89e5-45e2-945c-18cca8a53c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acaed389-ecd0-4915-8808-147b6cb300b2', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904fd63c-4428-475d-a425-14b118a84630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:16 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Volume volume-acaed389-ecd0-4915-8808-147b6cb300b2 (acaed389-ecd0-4915-8808-147b6cb300b2): created successfully Apr 09 13:32:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904fd63c-4428-475d-a425-14b118a84630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Flow 'volume_create_manager' (d5dcc984-df95-485a-a656-76042b172faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:16 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2321b64f-e2ed-40cc-bb4c-752aa1eef8fc tempest-VolumesImageMetadata-1470501434 None] Created volume successfully. Apr 09 13:32:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Acquiring lock "cinder-acaed389-ecd0-4915-8808-147b6cb300b2-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Lock "cinder-acaed389-ecd0-4915-8808-147b6cb300b2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Acquiring lock "cinder-quobyte-acaed389-ecd0-4915-8808-147b6cb300b2" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Lock "cinder-quobyte-acaed389-ecd0-4915-8808-147b6cb300b2" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:18 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[024ef5ce-9130-4db5-a101-9b9c08dc5261]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:18 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 Apr 09 13:32:18 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:19 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2" returned: 0 in 0.666s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:19 devstack sudo[85782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 Apr 09 13:32:19 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:19 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2" returned: 1 in 0.675s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:32:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:19 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2 Apr 09 13:32:19 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:20 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-acaed389-ecd0-4915-8808-147b6cb300b2" returned: 0 in 0.590s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Lock "cinder-quobyte-acaed389-ecd0-4915-8808-147b6cb300b2" released by "delete_volume" :: held 2.000s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:20 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Created reservations ['5ff20309-1447-464e-a564-e00a18caaf34', 'c6bbda09-9199-4174-8bac-e29251c02af3', 'd664c87a-910f-4f60-b716-803aa69239c0', 'a5273326-35fe-4b34-b4a5-c44590ce464e'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:20 devstack sudo[85791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:20 devstack sudo[85791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:21 devstack sudo[85791]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.500s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:21 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:21 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Deleted volume successfully. Apr 09 13:32:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c9a472-e8d3-44eb-9dee-caa278004320 tempest-VolumesImageMetadata-1470501434 None] Lock "cinder-acaed389-ecd0-4915-8808-147b6cb300b2-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (392a40fe-1e60-41c5-8f63-0f6b9f8988ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f5a547-a44e-4665-bbf3-5ecca8d48c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f5a547-a44e-4665-bbf3-5ecca8d48c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1382429486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1d7233-714d-4180-833f-a3c77e59896b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:23Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7981cf91-5fa6-4f11-92a9-743b90667c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7981cf91-5fa6-4f11-92a9-743b90667c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cbce54-4bfe-4e43-a816-0951cec832de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cbce54-4bfe-4e43-a816-0951cec832de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1d7233-714d-4180-833f-a3c77e59896b', 'volume_name': 'volume-6d1d7233-714d-4180-833f-a3c77e59896b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64aa31fb-cf4e-4100-bd1b-28cd0d792c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64aa31fb-cf4e-4100-bd1b-28cd0d792c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f0f673-99f3-4c8e-80ec-f65c688c15a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:23 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Volume 6d1d7233-714d-4180-833f-a3c77e59896b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1d7233-714d-4180-833f-a3c77e59896b', 'volume_size': 1} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1382429486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1d7233-714d-4180-833f-a3c77e59896b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:23Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Creating volume 6d1d7233-714d-4180-833f-a3c77e59896b {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:23 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:23 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b 1073741824 Apr 09 13:32:23 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:23 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b 1073741824" returned: 0 in 0.715s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:23 devstack sudo[85800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b Apr 09 13:32:23 devstack sudo[85800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Flow 'volume_create_manager' (e6f1803f-5f8a-4d07-a3f4-1c45a70dc893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81209d46-aee1-4d6c-b740-5f53bfe6f7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81209d46-aee1-4d6c-b740-5f53bfe6f7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-812047674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02be024e-434b-4b8c-b3c4-f11314a58783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ea29baee7b42ba99963cb342c715d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:24Z,use_quota=True,user_id='c68afa2155a9426d9d35b054b5b4aa05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b61f195-e93c-4bd4-92af-7b575082ef21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b61f195-e93c-4bd4-92af-7b575082ef21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc15c21-a5b8-49b1-b70b-ed9229798e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc15c21-a5b8-49b1-b70b-ed9229798e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02be024e-434b-4b8c-b3c4-f11314a58783', 'volume_name': 'volume-02be024e-434b-4b8c-b3c4-f11314a58783', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aabf025-caa8-4d5e-81d7-789103b4490a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aabf025-caa8-4d5e-81d7-789103b4490a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad33f2b-fb8e-45a6-bafa-74a50eb759aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:23 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Volume 02be024e-434b-4b8c-b3c4-f11314a58783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02be024e-434b-4b8c-b3c4-f11314a58783', 'volume_size': 1} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Flow 'volume_create_manager' (2de32aa7-ab09-49f5-b700-44f578973958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61aa269-9680-4270-a901-70f92991fc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61aa269-9680-4270-a901-70f92991fc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-326615475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5cbe1e4-1f48-4d49-b404-80ea3b546a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3926fab26068486aafd768d4a0d11f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:24Z,use_quota=True,user_id='90e2f1d9e7694f7693164e33d378955c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad82b51c-079d-4870-b685-5bd85270a53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad82b51c-079d-4870-b685-5bd85270a53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8456a80-2eca-4f23-a4f1-58a32ac1ea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8456a80-2eca-4f23-a4f1-58a32ac1ea47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5cbe1e4-1f48-4d49-b404-80ea3b546a4a', 'volume_name': 'volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33d4a67-1a10-4361-a40d-fb90783df56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33d4a67-1a10-4361-a40d-fb90783df56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c975970-bd5b-4ffd-a293-994f49705641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:24 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Volume d5cbe1e4-1f48-4d49-b404-80ea3b546a4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a', 'volume_size': 1} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:24 devstack sudo[85800]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b" returned: 0 in 0.472s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-812047674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02be024e-434b-4b8c-b3c4-f11314a58783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ea29baee7b42ba99963cb342c715d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:24Z,use_quota=True,user_id='c68afa2155a9426d9d35b054b5b4aa05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Creating volume 02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:24 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55f0f673-99f3-4c8e-80ec-f65c688c15a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1d7233-714d-4180-833f-a3c77e59896b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d450914b-2047-4744-be0c-8d664ddc01a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:24 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 1073741824 Apr 09 13:32:24 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:24 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Volume volume-6d1d7233-714d-4180-833f-a3c77e59896b (6d1d7233-714d-4180-833f-a3c77e59896b): created successfully Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d450914b-2047-4744-be0c-8d664ddc01a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (392a40fe-1e60-41c5-8f63-0f6b9f8988ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:24 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-300160d4-7c09-4365-8507-ca2786dfc9e7 tempest-VolumesActionsTest-870928099 None] Created volume successfully. Apr 09 13:32:24 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 1073741824" returned: 0 in 0.620s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:25 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 Apr 09 13:32:25 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Acquiring lock "cinder-6d1d7233-714d-4180-833f-a3c77e59896b-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Lock "cinder-6d1d7233-714d-4180-833f-a3c77e59896b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Acquiring lock "cinder-quobyte-6d1d7233-714d-4180-833f-a3c77e59896b" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Lock "cinder-quobyte-6d1d7233-714d-4180-833f-a3c77e59896b" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d9d8d-39a2-425c-815e-72965a49fd97]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:25 devstack sudo[85810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b Apr 09 13:32:25 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:25 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783" returned: 0 in 0.497s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.461s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-326615475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5cbe1e4-1f48-4d49-b404-80ea3b546a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3926fab26068486aafd768d4a0d11f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:24Z,use_quota=True,user_id='90e2f1d9e7694f7693164e33d378955c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Creating volume d5cbe1e4-1f48-4d49-b404-80ea3b546a4a {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:25 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad33f2b-fb8e-45a6-bafa-74a50eb759aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02be024e-434b-4b8c-b3c4-f11314a58783', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5af4dc-0fbf-4135-8966-2d7f6f77e1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:25 devstack sudo[85813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a 1073741824 Apr 09 13:32:25 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:25 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Volume volume-02be024e-434b-4b8c-b3c4-f11314a58783 (02be024e-434b-4b8c-b3c4-f11314a58783): created successfully Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5af4dc-0fbf-4135-8966-2d7f6f77e1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Flow 'volume_create_manager' (e6f1803f-5f8a-4d07-a3f4-1c45a70dc893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:25 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-aec0bbac-5ced-4410-a5f7-fde3c6da112e tempest-VolumesDeleteCascade-2098137462 None] Created volume successfully. Apr 09 13:32:26 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b" returned: 0 in 0.831s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:26 devstack sudo[85822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b Apr 09 13:32:26 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:26 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a 1073741824" returned: 0 in 0.710s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:26 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a Apr 09 13:32:26 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:26 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6d1d7233-714d-4180-833f-a3c77e59896b" returned: 0 in 0.535s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Lock "cinder-quobyte-6d1d7233-714d-4180-833f-a3c77e59896b" released by "delete_volume" :: held 1.406s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=112,cinder:DELETE=7,cinder:UPDATE=122,cinder:INSERT=33 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=110,cinder:DELETE=13,cinder:UPDATE=132,cinder:INSERT=40 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:32:26 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Created reservations ['436b3812-66e4-451e-8f4e-c663a126a4e7', '2bd3147c-f634-4262-88fc-2bf75324fe9b', '7f5827ab-d39e-41ae-a02b-c70e5c4fef8e', 'efcbaa16-4505-4b63-b680-cdfd953cbe06'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a" returned: 0 in 0.534s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.608s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c975970-bd5b-4ffd-a293-994f49705641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57183da8-59f3-4af9-b607-213337b2abca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] Creating offline snapshot 214450dc-5520-4473-83fd-be1e291d115a of volume 02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4d0572-9474-447b-878e-48afc004fe76]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:26 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:26 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Volume volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a (d5cbe1e4-1f48-4d49-b404-80ea3b546a4a): created successfully Apr 09 13:32:26 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57183da8-59f3-4af9-b607-213337b2abca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:26 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Flow 'volume_create_manager' (2de32aa7-ab09-49f5-b700-44f578973958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:26 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e08ec6a1-3857-4885-abeb-858d40afbda3 tempest-VolumesNegativeTest-173655551 None] Created volume successfully. Apr 09 13:32:26 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 Apr 09 13:32:26 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:27 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.484s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:27 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Deleted volume successfully. Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-bdba41b4-9eea-44d3-ba6b-1ad216cae37f tempest-VolumesActionsTest-1368961385 None] Lock "cinder-6d1d7233-714d-4180-833f-a3c77e59896b-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:27 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783" returned: 0 in 0.719s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:27 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a 1G Apr 09 13:32:27 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (7ea62532-6ca6-4bcf-a1a5-f8f53478088f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920e1a88-1e3f-4ac9-a929-8e0d25b8ea77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920e1a88-1e3f-4ac9-a929-8e0d25b8ea77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-486384114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806779db-40a6-4da9-a138-ecf312f22815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:28Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e791fe-7a3c-4f70-9d11-6ae2e9e5b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e791fe-7a3c-4f70-9d11-6ae2e9e5b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff48eeac-9569-4d51-9ed0-ea1b40ce9d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff48eeac-9569-4d51-9ed0-ea1b40ce9d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '806779db-40a6-4da9-a138-ecf312f22815', 'volume_name': 'volume-806779db-40a6-4da9-a138-ecf312f22815', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16164041-60fd-4a32-ac1a-60f7f52b5fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16164041-60fd-4a32-ac1a-60f7f52b5fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463debe7-4649-478f-8145-e3a6f84a123a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:27 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Volume 806779db-40a6-4da9-a138-ecf312f22815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-806779db-40a6-4da9-a138-ecf312f22815', 'volume_size': 1} Apr 09 13:32:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:28 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a 1G" returned: 0 in 0.620s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be024e-434b-4b8c-b3c4-f11314a58783 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:28 devstack sudo[85845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be024e-434b-4b8c-b3c4-f11314a58783 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a Apr 09 13:32:28 devstack sudo[85845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:28 devstack sudo[85845]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be024e-434b-4b8c-b3c4-f11314a58783 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a" returned: 0 in 0.534s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:28 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a is being set with open permissions: ugo+rw Apr 09 13:32:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:28 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a Apr 09 13:32:28 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:29 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a" returned: 0 in 0.487s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:29 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.info Apr 09 13:32:29 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:29 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.info" returned: 0 in 0.489s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:29 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.info is being set with open permissions: ugo+rw Apr 09 13:32:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:29 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.info Apr 09 13:32:29 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:30 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.info" returned: 0 in 0.491s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.468s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.284s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-486384114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806779db-40a6-4da9-a138-ecf312f22815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:28Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Creating volume 806779db-40a6-4da9-a138-ecf312f22815 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:30 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:30 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-c7f02e05-e9cb-4be0-9400-fe972117be4a tempest-VolumesDeleteCascade-2098137462 None] Create snapshot completed successfully Apr 09 13:32:30 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815 1073741824 Apr 09 13:32:30 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:30 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815 1073741824" returned: 0 in 0.599s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:30 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815 Apr 09 13:32:30 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:31 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815" returned: 0 in 0.459s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463debe7-4649-478f-8145-e3a6f84a123a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806779db-40a6-4da9-a138-ecf312f22815', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5212e44-5e0b-4094-9d6f-ff1ec1bc44a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:31 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Volume volume-806779db-40a6-4da9-a138-ecf312f22815 (806779db-40a6-4da9-a138-ecf312f22815): created successfully Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5212e44-5e0b-4094-9d6f-ff1ec1bc44a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (7ea62532-6ca6-4bcf-a1a5-f8f53478088f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:31 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2ad099d7-d0b5-4aaf-bda8-b68f397bcfa9 tempest-VolumesActionsTest-870928099 None] Created volume successfully. Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] Creating offline snapshot c1b83f8f-e6cf-4767-b9c0-a233aee181bb of volume 02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bc7f02-c222-4a9e-9a86-acb162987cb6]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:31 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a Apr 09 13:32:31 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:32 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a" returned: 0 in 0.635s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02be024e-434b-4b8c-b3c4-f11314a58783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:32:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:32 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb 1G Apr 09 13:32:32 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Acquiring lock "cinder-806779db-40a6-4da9-a138-ecf312f22815-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Lock "cinder-806779db-40a6-4da9-a138-ecf312f22815-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Acquiring lock "cinder-quobyte-806779db-40a6-4da9-a138-ecf312f22815" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Lock "cinder-quobyte-806779db-40a6-4da9-a138-ecf312f22815" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:32 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1517026-ec01-4190-a55f-30eedea45804]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:32 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815 Apr 09 13:32:32 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:33 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815" returned: 0 in 0.630s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:33 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb 1G" returned: 0 in 0.935s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:33 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815 Apr 09 13:32:33 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:33 devstack sudo[85892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb Apr 09 13:32:33 devstack sudo[85892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_service.periodic_task [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82346) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:33 devstack sudo[85895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:33 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:33 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-806779db-40a6-4da9-a138-ecf312f22815" returned: 0 in 0.678s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Lock "cinder-quobyte-806779db-40a6-4da9-a138-ecf312f22815" released by "delete_volume" :: held 1.365s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:33 devstack sudo[85892]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb" returned: 0 in 0.716s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:33 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb is being set with open permissions: ugo+rw Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Created reservations ['8cf874bf-6508-4f72-a542-1f7c1e2516ab', 'd8f4a647-6810-4ed8-9c03-f66e1a65e64b', '3b582427-a81b-4ac4-b5d2-75522ccdb55e', 'a681255e-b631-4cf5-9eba-018ecde83777'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:33 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb Apr 09 13:32:33 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:33 devstack sudo[85904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:33 devstack sudo[85904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:34 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.845s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:34 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb" returned: 0 in 0.513s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.903s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:34 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e6e17e2c-2fbc-4e74-9147-2a047f798dcf tempest-VolumesDeleteCascade-2098137462 None] Create snapshot completed successfully Apr 09 13:32:34 devstack sudo[85904]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.596s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:34 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Deleted volume successfully. Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d901945f-87cb-40dd-9678-a16667597c2d tempest-VolumesActionsTest-1368961385 None] Lock "cinder-806779db-40a6-4da9-a138-ecf312f22815-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-02be024e-434b-4b8c-b3c4-f11314a58783-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-02be024e-434b-4b8c-b3c4-f11314a58783-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Performing cascade delete. {{(pid=82346) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-214450dc-5520-4473-83fd-be1e291d115a-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-214450dc-5520-4473-83fd-be1e291d115a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-quobyte-02be024e-434b-4b8c-b3c4-f11314a58783" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-02be024e-434b-4b8c-b3c4-f11314a58783" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-quobyte-214450dc-5520-4473-83fd-be1e291d115a" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-214450dc-5520-4473-83fd-be1e291d115a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Deleting offline snapshot 214450dc-5520-4473-83fd-be1e291d115a of volume 02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] snapshot_file for this snap is: volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3427d6a6-d555-487e-9e30-3ff762a16c1d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:34 devstack sudo[85926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a Apr 09 13:32:34 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:34 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (ebccdeea-e879-48d9-95d1-c0d11761de88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1612b1f-35e0-498a-b92d-2f6a63b048bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1612b1f-35e0-498a-b92d-2f6a63b048bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1054260371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d97af0c-5ac5-4801-819d-50e3c000d132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:35Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e336f4-7bd4-44c5-b3ed-189c17a8db7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e336f4-7bd4-44c5-b3ed-189c17a8db7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cd60ea-8680-43f3-903d-8bd956e85041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cd60ea-8680-43f3-903d-8bd956e85041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d97af0c-5ac5-4801-819d-50e3c000d132', 'volume_name': 'volume-0d97af0c-5ac5-4801-819d-50e3c000d132', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4ba0f8-b07a-406b-ae80-d3388a17ae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4ba0f8-b07a-406b-ae80-d3388a17ae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fda63d9-7471-4bb7-964c-f81175ce7856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:35 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Volume 0d97af0c-5ac5-4801-819d-50e3c000d132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d97af0c-5ac5-4801-819d-50e3c000d132', 'volume_size': 1} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1054260371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d97af0c-5ac5-4801-819d-50e3c000d132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:35Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Creating volume 0d97af0c-5ac5-4801-819d-50e3c000d132 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:35 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:35 devstack sudo[85928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132 1073741824 Apr 09 13:32:35 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:35 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a" returned: 0 in 0.632s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02be024e-434b-4b8c-b3c4-f11314a58783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[7906e6b0-5da9-46b1-b0f9-0fc4aaca0f33]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:35 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 Apr 09 13:32:35 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:35 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132 1073741824" returned: 0 in 0.597s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:35 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132 Apr 09 13:32:35 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:36 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783" returned: 0 in 0.541s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[2099f292-3598-4d72-b1bb-f1ed0b4da9e0]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:36 devstack sudo[85945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb Apr 09 13:32:36 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:36 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132" returned: 0 in 0.525s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fda63d9-7471-4bb7-964c-f81175ce7856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d97af0c-5ac5-4801-819d-50e3c000d132', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb22361f-39a7-433d-8d37-9f82246c8434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:36 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Volume volume-0d97af0c-5ac5-4801-819d-50e3c000d132 (0d97af0c-5ac5-4801-819d-50e3c000d132): created successfully Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb22361f-39a7-433d-8d37-9f82246c8434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (ebccdeea-e879-48d9-95d1-c0d11761de88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:36 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-5d09024d-1dc5-46d4-aed5-e113c9433bc1 tempest-VolumesActionsTest-870928099 None] Created volume successfully. Apr 09 13:32:36 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb" returned: 0 in 0.588s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02be024e-434b-4b8c-b3c4-f11314a58783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[c298faf6-3bc5-4e56-a787-670aa41dee5b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:36 devstack sudo[85950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a Apr 09 13:32:36 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:37 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a" returned: 0 in 0.563s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02be024e-434b-4b8c-b3c4-f11314a58783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51134af-49f9-440d-a430-3c4f624a774e]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Acquiring lock "cinder-0d97af0c-5ac5-4801-819d-50e3c000d132-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Lock "cinder-0d97af0c-5ac5-4801-819d-50e3c000d132-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Acquiring lock "cinder-quobyte-0d97af0c-5ac5-4801-819d-50e3c000d132" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:37 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 Apr 09 13:32:37 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Lock "cinder-quobyte-0d97af0c-5ac5-4801-819d-50e3c000d132" acquired by "delete_volume" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1951fb8-8a92-4a37-9cd9-dddc399ad0ae]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:37 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132 Apr 09 13:32:37 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:37 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783" returned: 0 in 0.712s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:37 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a Apr 09 13:32:37 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:37 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132" returned: 0 in 0.607s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:37 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132 Apr 09 13:32:37 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:38 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0d97af0c-5ac5-4801-819d-50e3c000d132" returned: 0 in 0.533s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Lock "cinder-quobyte-0d97af0c-5ac5-4801-819d-50e3c000d132" released by "delete_volume" :: held 1.175s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:38 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Created reservations ['aaf08dc6-e01c-47d7-bde2-264d32b0b2f6', '91e2ab84-4c74-4c1e-9a5a-d47dca24f9f2', '161e1a30-2148-4474-88b6-30ebf3289bf3', '4ad3f602-e287-4a8f-a820-5f203c6e636d'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:38 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a" returned: 0 in 0.665s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:38 devstack sudo[85977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a Apr 09 13:32:38 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:38 devstack sudo[85980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:38 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:39 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.214450dc-5520-4473-83fd-be1e291d115a" returned: 0 in 0.461s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be024e-434b-4b8c-b3c4-f11314a58783 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb -F qcow2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:39 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be024e-434b-4b8c-b3c4-f11314a58783 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb -F qcow2 Apr 09 13:32:39 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:39 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.508s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:39 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Deleted volume successfully. Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6bc1149b-15d7-4f49-95ec-fc5bc9b6f8b0 tempest-VolumesActionsTest-1368961385 None] Lock "cinder-0d97af0c-5ac5-4801-819d-50e3c000d132-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:39 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be024e-434b-4b8c-b3c4-f11314a58783 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb -F qcow2" returned: 0 in 0.734s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-214450dc-5520-4473-83fd-be1e291d115a" released by "_delete_snapshot" :: held 5.031s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-02be024e-434b-4b8c-b3c4-f11314a58783" released by "delete_snapshot" :: held 5.054s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Created reservations ['1c3cc3c5-78ae-4749-a72e-59961f21edb5', 'd430358d-0230-4704-9572-22dc5d854215', '60db0de3-72c3-4455-99ba-a58c2a987edd', '6abefede-7e8c-4a24-aac0-2ab68b99e25a'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:39 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Delete snapshot completed successfully. Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-214450dc-5520-4473-83fd-be1e291d115a-delete_snapshot" released by "delete_snapshot" :: held 5.193s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-c1b83f8f-e6cf-4767-b9c0-a233aee181bb-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-c1b83f8f-e6cf-4767-b9c0-a233aee181bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-quobyte-02be024e-434b-4b8c-b3c4-f11314a58783" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-02be024e-434b-4b8c-b3c4-f11314a58783" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-quobyte-c1b83f8f-e6cf-4767-b9c0-a233aee181bb" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-c1b83f8f-e6cf-4767-b9c0-a233aee181bb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Deleting offline snapshot c1b83f8f-e6cf-4767-b9c0-a233aee181bb of volume 02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] snapshot_file for this snap is: volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edf6727-4086-4eac-995c-3ac3b393e027]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:40 devstack sudo[86033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb Apr 09 13:32:40 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (7979deba-1997-4264-800e-67fad04c913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e07a46a-81b0-4834-aeac-6bf93d5766d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e07a46a-81b0-4834-aeac-6bf93d5766d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1133326824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e44377-0dbe-436e-b73d-264c93bcfb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:40Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f45702-9d17-4a0b-af9d-38eac57eddea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f45702-9d17-4a0b-af9d-38eac57eddea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d6c9f0-515f-4f87-99b9-6cac47d6adb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d6c9f0-515f-4f87-99b9-6cac47d6adb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e44377-0dbe-436e-b73d-264c93bcfb95', 'volume_name': 'volume-b4e44377-0dbe-436e-b73d-264c93bcfb95', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78817ff2-88f8-4008-b3cc-417e90ad21a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78817ff2-88f8-4008-b3cc-417e90ad21a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7696249b-dcdf-4eda-83cd-1758780f74f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:40 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Volume b4e44377-0dbe-436e-b73d-264c93bcfb95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e44377-0dbe-436e-b73d-264c93bcfb95', 'volume_size': 1} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1133326824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e44377-0dbe-436e-b73d-264c93bcfb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:40Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Creating volume b4e44377-0dbe-436e-b73d-264c93bcfb95 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:40 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:40 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95 1073741824 Apr 09 13:32:40 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:40 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb" returned: 0 in 0.868s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02be024e-434b-4b8c-b3c4-f11314a58783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[135d46b2-d8d8-42b3-a7ae-26ab8a6b2474]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:41 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 Apr 09 13:32:41 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:41 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95 1073741824" returned: 0 in 1.115s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:41 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95 Apr 09 13:32:41 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:42 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783" returned: 0 in 1.168s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:42 devstack sudo[86067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb Apr 09 13:32:42 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:42 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95" returned: 0 in 0.810s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:32:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7696249b-dcdf-4eda-83cd-1758780f74f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e44377-0dbe-436e-b73d-264c93bcfb95', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2849c1-889b-483a-821b-7ff007f2395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:42 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Volume volume-b4e44377-0dbe-436e-b73d-264c93bcfb95 (b4e44377-0dbe-436e-b73d-264c93bcfb95): created successfully Apr 09 13:32:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2849c1-889b-483a-821b-7ff007f2395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (7979deba-1997-4264-800e-67fad04c913c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:42 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-33d1e38e-ec44-4564-adb1-151861c6cb4e tempest-VolumesActionsTest-870928099 None] Created volume successfully. Apr 09 13:32:42 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb" returned: 0 in 0.580s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:42 devstack sudo[86075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb Apr 09 13:32:42 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:43 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783.c1b83f8f-e6cf-4767-b9c0-a233aee181bb" returned: 0 in 0.472s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-c1b83f8f-e6cf-4767-b9c0-a233aee181bb" released by "_delete_snapshot" :: held 3.203s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-02be024e-434b-4b8c-b3c4-f11314a58783" released by "delete_snapshot" :: held 3.222s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Created reservations ['65e342d7-4d71-45d2-a42e-6a6c99fb5172', 'd47f3303-140f-473d-af3a-e081bc34525a', 'ce352fb4-86c5-4296-979f-dc8a44126a96', 'a666b9c8-3384-4aa0-8450-0aba661767fe'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:43 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Delete snapshot completed successfully. Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-c1b83f8f-e6cf-4767-b9c0-a233aee181bb-delete_snapshot" released by "delete_snapshot" :: held 3.448s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Snapshots deleted, issuing volume delete {{(pid=82346) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-quobyte-02be024e-434b-4b8c-b3c4-f11314a58783" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-02be024e-434b-4b8c-b3c4-f11314a58783" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[2015e192-17bd-4a98-a908-122f49a4d49a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:43 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 Apr 09 13:32:43 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Acquiring lock "cinder-b4e44377-0dbe-436e-b73d-264c93bcfb95-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Lock "cinder-b4e44377-0dbe-436e-b73d-264c93bcfb95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Acquiring lock "cinder-quobyte-b4e44377-0dbe-436e-b73d-264c93bcfb95" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Lock "cinder-quobyte-b4e44377-0dbe-436e-b73d-264c93bcfb95" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdceafb6-fca1-40d1-baca-10b18920f04d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:43 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95 Apr 09 13:32:43 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:44 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783" returned: 0 in 0.719s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:44 devstack sudo[86121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783 Apr 09 13:32:44 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:44 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95" returned: 0 in 0.651s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:44 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95 Apr 09 13:32:44 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:45 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-02be024e-434b-4b8c-b3c4-f11314a58783" returned: 0 in 0.962s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-02be024e-434b-4b8c-b3c4-f11314a58783" released by "delete_volume" :: held 1.740s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Created reservations ['f2f6b7a5-9d44-4026-b8cc-739226e89f8c', '44411c48-9863-4a38-96f9-00e84fae1292', '198391dd-f664-488f-8fe1-30a32edfc363', '19807738-003c-4fa2-831d-93d0c5bc4ca2'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:45 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:45 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:45 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b4e44377-0dbe-436e-b73d-264c93bcfb95" returned: 0 in 1.027s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Lock "cinder-quobyte-b4e44377-0dbe-436e-b73d-264c93bcfb95" released by "delete_volume" :: held 1.713s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Created reservations ['816287d7-abfe-44c0-b135-cb58ee5c81a9', '081db675-1e35-42cf-8be6-ffd456da0e9c', '0c7b3771-1cea-41d9-b8ce-13a2163cf314', 'ef7d6ace-d88b-496f-bfc5-64c601dfb766'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:45 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:45 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:46 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:46 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Flow 'volume_create_manager' (cec32f5a-c740-413a-83e3-a6b6b3d6eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1484582-46b5-434e-8821-1923af989402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 1.601s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:46 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:46 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Deleted volume successfully. Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1484582-46b5-434e-8821-1923af989402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1031328016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a018102-434f-4917-a207-47d369519682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ea29baee7b42ba99963cb342c715d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:47Z,use_quota=True,user_id='c68afa2155a9426d9d35b054b5b4aa05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1682969-b27b-41e5-be97-ade77501b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1682969-b27b-41e5-be97-ade77501b493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f83955-f7b4-4dd2-8a3d-e67a981b22fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f83955-f7b4-4dd2-8a3d-e67a981b22fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a018102-434f-4917-a207-47d369519682', 'volume_name': 'volume-8a018102-434f-4917-a207-47d369519682', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c123c45-809a-4070-82e6-89b42f927357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c123c45-809a-4070-82e6-89b42f927357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00db5ea6-89f6-4c24-a99b-a914577500f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:47 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Volume 8a018102-434f-4917-a207-47d369519682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a018102-434f-4917-a207-47d369519682', 'volume_size': 1} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1031328016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a018102-434f-4917-a207-47d369519682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ea29baee7b42ba99963cb342c715d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:47Z,use_quota=True,user_id='c68afa2155a9426d9d35b054b5b4aa05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Creating volume 8a018102-434f-4917-a207-47d369519682 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:47 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:47 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 1073741824 Apr 09 13:32:47 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-146f7968-431c-4586-8a52-508b989e4a6c tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-02be024e-434b-4b8c-b3c4-f11314a58783-delete_volume" released by "delete_volume" :: held 12.579s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (b22bb200-3e8b-402d-8d2e-02d48382adba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27546595-ab91-4a14-8b2c-df2c9e35629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:47 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 1.737s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:47 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Deleted volume successfully. Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27546595-ab91-4a14-8b2c-df2c9e35629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-716137404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203049fd-5930-4eef-8a52-3f4d96593c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:47Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d41a19-9d87-4045-8842-94cb87202f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d41a19-9d87-4045-8842-94cb87202f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283450ed-0dea-4a33-87fd-dff722fe4c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283450ed-0dea-4a33-87fd-dff722fe4c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '203049fd-5930-4eef-8a52-3f4d96593c0f', 'volume_name': 'volume-203049fd-5930-4eef-8a52-3f4d96593c0f', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb54a29c-a60c-4187-9ea9-4a269c0a7746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb54a29c-a60c-4187-9ea9-4a269c0a7746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f5b58f-d36d-4400-91f8-8ac80b417e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:47 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Volume 203049fd-5930-4eef-8a52-3f4d96593c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-203049fd-5930-4eef-8a52-3f4d96593c0f', 'volume_size': 1} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:47 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e8dbe8c1-37bc-4fce-9840-2bb8de807006 tempest-VolumesActionsTest-1368961385 None] Lock "cinder-b4e44377-0dbe-436e-b73d-264c93bcfb95-delete_volume" released by "delete_volume" :: held 3.840s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:48 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 1073741824" returned: 0 in 0.876s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:48 devstack sudo[86210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 Apr 09 13:32:48 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:48 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682" returned: 0 in 0.437s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.072s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-716137404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203049fd-5930-4eef-8a52-3f4d96593c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58617078250c460a9af856aa5f9048d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:47Z,use_quota=True,user_id='eed9c4cffc7d4d4fa4847d68a52e8489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Creating volume 203049fd-5930-4eef-8a52-3f4d96593c0f {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:48 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00db5ea6-89f6-4c24-a99b-a914577500f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a018102-434f-4917-a207-47d369519682', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63db1d2-e923-4b1d-8ada-0518e66d270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:48 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f 1073741824 Apr 09 13:32:48 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:48 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Volume volume-8a018102-434f-4917-a207-47d369519682 (8a018102-434f-4917-a207-47d369519682): created successfully Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63db1d2-e923-4b1d-8ada-0518e66d270f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:48 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Flow 'volume_create_manager' (cec32f5a-c740-413a-83e3-a6b6b3d6eba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:48 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-534a2227-f6dd-4d04-9210-e16b1fea83d3 tempest-VolumesDeleteCascade-2098137462 None] Created volume successfully. Apr 09 13:32:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:49 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f 1073741824" returned: 0 in 1.029s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:49 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f Apr 09 13:32:49 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:50 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f" returned: 0 in 0.456s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:32:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.859s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f5b58f-d36d-4400-91f8-8ac80b417e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203049fd-5930-4eef-8a52-3f4d96593c0f', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afd27e2-d3e0-40f1-901b-429725ee5ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] Creating offline snapshot 733410c4-e041-4e6a-bf68-fc7faf2f957a of volume 8a018102-434f-4917-a207-47d369519682 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:32:50 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Volume volume-203049fd-5930-4eef-8a52-3f4d96593c0f (203049fd-5930-4eef-8a52-3f4d96593c0f): created successfully Apr 09 13:32:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afd27e2-d3e0-40f1-901b-429725ee5ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Flow 'volume_create_manager' (b22bb200-3e8b-402d-8d2e-02d48382adba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:50 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e1a010-631d-4a90-8c6d-75ef3ee7d80a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:50 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d1f17bbf-f49b-46c7-86de-a6b5616a28d8 tempest-VolumesActionsTest-870928099 None] Created volume successfully. Apr 09 13:32:50 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 Apr 09 13:32:50 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:51 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682" returned: 0 in 1.086s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:51 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a 1G Apr 09 13:32:51 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Acquiring lock "cinder-203049fd-5930-4eef-8a52-3f4d96593c0f-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Lock "cinder-203049fd-5930-4eef-8a52-3f4d96593c0f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Acquiring lock "cinder-quobyte-203049fd-5930-4eef-8a52-3f4d96593c0f" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Lock "cinder-quobyte-203049fd-5930-4eef-8a52-3f4d96593c0f" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:51 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[346db4c2-8d0e-47fa-81fa-f216d0287fd7]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:51 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f Apr 09 13:32:51 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:52 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a 1G" returned: 0 in 1.431s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a018102-434f-4917-a207-47d369519682 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:52 devstack sudo[86273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a018102-434f-4917-a207-47d369519682 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a Apr 09 13:32:52 devstack sudo[86273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:52 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f" returned: 0 in 1.186s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:52 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f Apr 09 13:32:52 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:53 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-203049fd-5930-4eef-8a52-3f4d96593c0f" returned: 0 in 0.779s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Lock "cinder-quobyte-203049fd-5930-4eef-8a52-3f4d96593c0f" released by "delete_volume" :: held 2.069s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:53 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Created reservations ['0117671f-f281-4937-9e86-980d0efa6de4', '73ffefa5-2232-4c8d-b127-0a038424cf57', 'f5e2eea3-bf25-4952-ab14-f1b4f71caa4e', 'fc97121f-9ca5-4b94-8e47-dd7893306bbf'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:53 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:32:53 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:53 devstack sudo[86273]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a018102-434f-4917-a207-47d369519682 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a" returned: 0 in 1.036s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:53 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a is being set with open permissions: ugo+rw Apr 09 13:32:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:53 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a Apr 09 13:32:53 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:54 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.932s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:54 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:32:54 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Deleted volume successfully. Apr 09 13:32:54 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0015da03-2c66-4852-a5cd-ba108b90a3e6 tempest-VolumesActionsTest-870928099 None] Lock "cinder-203049fd-5930-4eef-8a52-3f4d96593c0f-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:54 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a" returned: 0 in 1.000s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:54 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.info Apr 09 13:32:54 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:55 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.info" returned: 0 in 0.728s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:55 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.info is being set with open permissions: ugo+rw Apr 09 13:32:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:55 devstack sudo[86323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.info Apr 09 13:32:55 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:56 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.info" returned: 0 in 0.594s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:56 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-5c52a9de-33fd-454e-ad6c-7c4b54bb34c7 tempest-VolumesDeleteCascade-2098137462 None] Create snapshot completed successfully Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Flow 'volume_create_manager' (e70cd2e7-ec78-40e6-953a-5c9d4efbd9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713391de-7dc2-466d-963e-83b61dacdba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713391de-7dc2-466d-963e-83b61dacdba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1272060495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feba20fb-0bf7-4810-a9e8-e2b501286eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7ea29baee7b42ba99963cb342c715d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=733410c4-e041-4e6a-bf68-fc7faf2f957a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:32:57Z,use_quota=True,user_id='c68afa2155a9426d9d35b054b5b4aa05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0c8520-8317-4cdd-a79b-663d0b847b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0c8520-8317-4cdd-a79b-663d0b847b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6950f2aa-521a-4890-bbb5-6d06ac916528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6950f2aa-521a-4890-bbb5-6d06ac916528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'feba20fb-0bf7-4810-a9e8-e2b501286eb5', 'volume_name': 'volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5', 'volume_size': 1, 'snapshot_id': '733410c4-e041-4e6a-bf68-fc7faf2f957a'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed94b2df-a245-4524-b8ee-6f12f7c36019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed94b2df-a245-4524-b8ee-6f12f7c36019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38fa7d1-567f-419d-afa9-2e76ddb7084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:32:57 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Volume feba20fb-0bf7-4810-a9e8-e2b501286eb5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5', 'volume_size': 1, 'snapshot_id': '733410c4-e041-4e6a-bf68-fc7faf2f957a'} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-quobyte-733410c4-e041-4e6a-bf68-fc7faf2f957a-feba20fb-0bf7-4810-a9e8-e2b501286eb5" by "_create_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-733410c4-e041-4e6a-bf68-fc7faf2f957a-feba20fb-0bf7-4810-a9e8-e2b501286eb5" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Creating volume feba20fb-0bf7-4810-a9e8-e2b501286eb5 from snapshot 733410c4-e041-4e6a-bf68-fc7faf2f957a {{(pid=82346) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-quobyte-feba20fb-0bf7-4810-a9e8-e2b501286eb5" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-feba20fb-0bf7-4810-a9e8-e2b501286eb5" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] snapshot: 733410c4-e041-4e6a-bf68-fc7faf2f957a, volume: feba20fb-0bf7-4810-a9e8-e2b501286eb5, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfe81ef-3431-4d9b-bc0c-6e343e54a355]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:57 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a Apr 09 13:32:57 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Acquiring lock "cinder-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Lock "cinder-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Acquiring lock "cinder-quobyte-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Lock "cinder-quobyte-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a" acquired by "delete_volume" :: waited 0.031s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0763768c-bbc5-40e5-839f-17e0ffc093e5]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:58 devstack sudo[86332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a Apr 09 13:32:58 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:58 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a" returned: 0 in 0.723s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a018102-434f-4917-a207-47d369519682(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:32:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:32:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:32:58 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[52118e4e-398f-44dd-9a1e-5efb6b0b027d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:32:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:58 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 Apr 09 13:32:58 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:58 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a" returned: 0 in 0.992s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:58 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a Apr 09 13:32:58 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:59 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682" returned: 0 in 1.306s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:32:59 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 Apr 09 13:32:59 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:32:59 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a" returned: 0 in 0.846s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Lock "cinder-quobyte-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a" released by "delete_volume" :: held 1.881s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Created reservations ['f5a28e7b-e4ca-47f5-8613-2a723e20d4e9', '4cf5dde1-9a5f-4d45-9d96-0ba315a71139', '99c9605f-155a-4bff-ba39-da03d8044bac', 'd13ffc0d-6fea-4b96-8864-239ab2cb0033'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:32:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:00 devstack sudo[86381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:00 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:02 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 2.495s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:02 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:02 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Deleted volume successfully. Apr 09 13:33:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3d4b6004-ea68-46c8-97fd-b21e63c116e2 tempest-VolumesNegativeTest-173655551 None] Lock "cinder-d5cbe1e4-1f48-4d49-b404-80ea3b546a4a-delete_volume" released by "delete_volume" :: held 4.809s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:03 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5" returned: 0 in 4.093s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:03 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0035fbf0-2185-4612-a561-b35663a75bec]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:03 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 Apr 09 13:33:03 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Flow 'volume_create_manager' (df0dd54c-c66f-4936-a567-f15c2f33e993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a5378b-10f7-4ee0-b9f6-dde0a3190633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a5378b-10f7-4ee0-b9f6-dde0a3190633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-160430569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8327fcb4-498f-4d80-a777-204b4b3d18a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865904ef0f5046b3860fc9f8aeacf476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:05Z,use_quota=True,user_id='dbd8c62a6768433fbc86f12a7e93e547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2779f5e7-a895-4da5-827e-bd72007eedcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2779f5e7-a895-4da5-827e-bd72007eedcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1338af2f-c5c8-4c77-9e43-323e406c7d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1338af2f-c5c8-4c77-9e43-323e406c7d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8327fcb4-498f-4d80-a777-204b4b3d18a6', 'volume_name': 'volume-8327fcb4-498f-4d80-a777-204b4b3d18a6', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f752d58-6fb7-4061-9ee8-5f63ad2f2f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f752d58-6fb7-4061-9ee8-5f63ad2f2f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9385b3d-ae54-440a-871d-6fd7d3681450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:04 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Volume 8327fcb4-498f-4d80-a777-204b4b3d18a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8327fcb4-498f-4d80-a777-204b4b3d18a6', 'volume_size': 1} Apr 09 13:33:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:05 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682" returned: 0 in 1.429s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:33:05 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Converted 1024.00 MB image at 250.11 MB/s Apr 09 13:33:05 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 is being set with open permissions: ugo+rw Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:05 devstack sudo[86401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 Apr 09 13:33:05 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:05 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5" returned: 0 in 0.816s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-feba20fb-0bf7-4810-a9e8-e2b501286eb5" released by "_copy_volume_from_snapshot" :: held 8.458s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-733410c4-e041-4e6a-bf68-fc7faf2f957a-feba20fb-0bf7-4810-a9e8-e2b501286eb5" released by "_create_volume_from_snapshot" :: held 8.481s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.492s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.878s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-160430569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8327fcb4-498f-4d80-a777-204b4b3d18a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865904ef0f5046b3860fc9f8aeacf476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:05Z,use_quota=True,user_id='dbd8c62a6768433fbc86f12a7e93e547',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Creating volume 8327fcb4-498f-4d80-a777-204b4b3d18a6 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:05 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:05 devstack sudo[86406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6 1073741824 Apr 09 13:33:05 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38fa7d1-567f-419d-afa9-2e76ddb7084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5', 'volume_size': 1, 'snapshot_id': '733410c4-e041-4e6a-bf68-fc7faf2f957a'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff50f84c-283f-4d82-ac1b-44b0b0126e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:06 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Volume volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 (feba20fb-0bf7-4810-a9e8-e2b501286eb5): created successfully Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff50f84c-283f-4d82-ac1b-44b0b0126e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Flow 'volume_create_manager' (e70cd2e7-ec78-40e6-953a-5c9d4efbd9a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:06 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-74647c57-78fc-49c9-b4d8-a13a312592dc tempest-VolumesDeleteCascade-2098137462 None] Created volume successfully. Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-8a018102-434f-4917-a207-47d369519682-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-8a018102-434f-4917-a207-47d369519682-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Performing cascade delete. {{(pid=82346) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-733410c4-e041-4e6a-bf68-fc7faf2f957a-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-733410c4-e041-4e6a-bf68-fc7faf2f957a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-quobyte-8a018102-434f-4917-a207-47d369519682" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-8a018102-434f-4917-a207-47d369519682" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-quobyte-733410c4-e041-4e6a-bf68-fc7faf2f957a" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-733410c4-e041-4e6a-bf68-fc7faf2f957a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Deleting offline snapshot 733410c4-e041-4e6a-bf68-fc7faf2f957a of volume 8a018102-434f-4917-a207-47d369519682 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] snapshot_file for this snap is: volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7e11a9-b5d8-43d7-b24b-1ff438e3a0fb]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:07 devstack sudo[86411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a Apr 09 13:33:07 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:07 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6 1073741824" returned: 0 in 1.413s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:07 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6 Apr 09 13:33:07 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:07 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a" returned: 0 in 1.091s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a018102-434f-4917-a207-47d369519682(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:33:08 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6" returned: 0 in 0.697s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c509ca4-82b4-4369-a520-8675aa7afc8a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9385b3d-ae54-440a-871d-6fd7d3681450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8327fcb4-498f-4d80-a777-204b4b3d18a6', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa739c-33ad-4a72-8299-856ab4830eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:08 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Volume volume-8327fcb4-498f-4d80-a777-204b4b3d18a6 (8327fcb4-498f-4d80-a777-204b4b3d18a6): created successfully Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fa739c-33ad-4a72-8299-856ab4830eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Flow 'volume_create_manager' (df0dd54c-c66f-4936-a567-f15c2f33e993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:08 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-bfb169b0-4e3c-4df2-986f-6cd59d618a54 tempest-ServerRescueNegativeTestJSON-838222255 None] Created volume successfully. Apr 09 13:33:08 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 Apr 09 13:33:08 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:08 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682" returned: 0 in 0.847s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:08 devstack sudo[86435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a Apr 09 13:33:08 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Flow 'volume_create_manager' (316d11b9-d489-4898-827a-eb4e4fdc1152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b61ac6-a4b9-402a-bd50-25ff5dd7aec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b61ac6-a4b9-402a-bd50-25ff5dd7aec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1151869694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30ba4a5-8549-41c0-934d-9cd819ae0958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172cd619b2cc4cb7bdb54ddb5dda6a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:10Z,use_quota=True,user_id='9eeefb6fbb5440348e48010db68246a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1892b177-0217-4749-bc62-314e74f69fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1892b177-0217-4749-bc62-314e74f69fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6f8d56-8235-4558-a6a9-1d44243359cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6f8d56-8235-4558-a6a9-1d44243359cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd30ba4a5-8549-41c0-934d-9cd819ae0958', 'volume_name': 'volume-d30ba4a5-8549-41c0-934d-9cd819ae0958', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcaf6721-1914-451b-9715-8c00b1941499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcaf6721-1914-451b-9715-8c00b1941499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5971a250-27af-46ef-8ba8-d580f3850a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:09 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Volume d30ba4a5-8549-41c0-934d-9cd819ae0958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d30ba4a5-8549-41c0-934d-9cd819ae0958', 'volume_size': 1} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1151869694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30ba4a5-8549-41c0-934d-9cd819ae0958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172cd619b2cc4cb7bdb54ddb5dda6a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:10Z,use_quota=True,user_id='9eeefb6fbb5440348e48010db68246a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Creating volume d30ba4a5-8549-41c0-934d-9cd819ae0958 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:10 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:10 devstack sudo[86441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 1073741824 Apr 09 13:33:10 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:10 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a" returned: 0 in 1.210s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:10 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a Apr 09 13:33:10 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:11 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682.733410c4-e041-4e6a-bf68-fc7faf2f957a" returned: 0 in 1.114s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:11 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 1073741824" returned: 0 in 1.309s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-733410c4-e041-4e6a-bf68-fc7faf2f957a" released by "_delete_snapshot" :: held 4.535s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-8a018102-434f-4917-a207-47d369519682" released by "delete_snapshot" :: held 4.578s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:11 devstack sudo[86470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 Apr 09 13:33:11 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Created reservations ['002e6c40-f457-4979-9c00-e1b2dc8a15df', '51d59047-c6b6-4b2a-87eb-478ef817b716', '2a5a9544-6788-429b-b30f-92c9490ac987', '2dd3a35a-a80e-47fd-b1da-8ee452b8c707'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:11 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Delete snapshot completed successfully. Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-733410c4-e041-4e6a-bf68-fc7faf2f957a-delete_snapshot" released by "delete_snapshot" :: held 4.879s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Snapshots deleted, issuing volume delete {{(pid=82346) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-quobyte-8a018102-434f-4917-a207-47d369519682" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-8a018102-434f-4917-a207-47d369519682" acquired by "delete_volume" :: waited 0.023s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[812821e3-6cdd-4642-89db-c8adacc9d594]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:11 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 Apr 09 13:33:11 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:12 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958" returned: 0 in 0.919s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] <== create_volume: return (2367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.371s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5971a250-27af-46ef-8ba8-d580f3850a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d30ba4a5-8549-41c0-934d-9cd819ae0958', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85bc0968-611f-46e5-b59f-8d1d9c76de45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:12 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Volume volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 (d30ba4a5-8549-41c0-934d-9cd819ae0958): created successfully Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85bc0968-611f-46e5-b59f-8d1d9c76de45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Flow 'volume_create_manager' (316d11b9-d489-4898-827a-eb4e4fdc1152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:12 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f986713e-b7de-4f49-a002-624f11e9411f tempest-SnapshotMetadataTestJSON-98818130 None] Created volume successfully. Apr 09 13:33:12 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682" returned: 0 in 1.109s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] Creating offline snapshot 75a2fd55-c364-4a25-8ce3-2383cfb1e741 of volume d30ba4a5-8549-41c0-934d-9cd819ae0958 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:33:12 devstack sudo[86478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682 Apr 09 13:33:12 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:13 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbf7c32-a614-4509-8f5a-a84253c80cb5]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:13 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 Apr 09 13:33:13 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:13 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8a018102-434f-4917-a207-47d369519682" returned: 0 in 0.969s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-8a018102-434f-4917-a207-47d369519682" released by "delete_volume" :: held 2.192s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:13 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Created reservations ['67b34ef1-3062-46ec-8dd4-74385fb31569', '01bc974f-35a2-46cf-8c55-3930a9492013', '86ead48b-fc8d-4972-bd70-de1c834356da', 'b0cfcf2b-5fb3-4308-b7ad-3003d826f03a'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:13 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958" returned: 0 in 0.966s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:14 devstack sudo[86508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 1G Apr 09 13:33:14 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:14 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:14 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:14 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.637s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:14 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Deleted volume successfully. Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e33b7f8e-74d6-46bb-8078-4b2b3c1c68cd tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-8a018102-434f-4917-a207-47d369519682-delete_volume" released by "delete_volume" :: held 8.008s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-feba20fb-0bf7-4810-a9e8-e2b501286eb5-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-feba20fb-0bf7-4810-a9e8-e2b501286eb5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "cinder-quobyte-feba20fb-0bf7-4810-a9e8-e2b501286eb5" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-feba20fb-0bf7-4810-a9e8-e2b501286eb5" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad262c3-4e71-4553-a0b9-10275a8a1dfe]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:15 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 1G" returned: 0 in 1.003s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:15 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 Apr 09 13:33:15 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:15 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 Apr 09 13:33:15 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:15 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741" returned: 0 in 0.594s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:15 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 is being set with open permissions: ugo+rw Apr 09 13:33:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:15 devstack sudo[86529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 Apr 09 13:33:15 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:16 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5" returned: 0 in 1.057s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:16 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5 Apr 09 13:33:16 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:16 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741" returned: 0 in 0.795s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:16 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.info Apr 09 13:33:16 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:16 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-feba20fb-0bf7-4810-a9e8-e2b501286eb5" returned: 0 in 0.607s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-quobyte-feba20fb-0bf7-4810-a9e8-e2b501286eb5" released by "delete_volume" :: held 1.715s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Created reservations ['059626af-ce3a-4edd-9976-e39db4b4803f', '55541435-1192-4a81-b834-552498f02e23', '0c1fb2a5-1228-4130-b5e6-5ba5989740a4', '0356443f-34b0-48ab-afc3-f5ebb25d54ed'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:16 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:16 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:17 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.info" returned: 0 in 0.816s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:17 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.info is being set with open permissions: ugo+rw Apr 09 13:33:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:17 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.info Apr 09 13:33:17 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:17 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.635s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:17 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:17 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Deleted volume successfully. Apr 09 13:33:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-eb3ae479-ea46-40e5-83fb-aabc12deab69 tempest-VolumesDeleteCascade-2098137462 None] Lock "cinder-feba20fb-0bf7-4810-a9e8-e2b501286eb5-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:17 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.info" returned: 0 in 0.569s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.913s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:17 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-74ce5f20-e41d-4e74-86ae-6c4951f42ce4 tempest-SnapshotMetadataTestJSON-98818130 None] Create snapshot completed successfully Apr 09 13:33:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Acquiring lock "cinder-75a2fd55-c364-4a25-8ce3-2383cfb1e741-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Lock "cinder-75a2fd55-c364-4a25-8ce3-2383cfb1e741-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Acquiring lock "cinder-quobyte-d30ba4a5-8549-41c0-934d-9cd819ae0958" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Lock "cinder-quobyte-d30ba4a5-8549-41c0-934d-9cd819ae0958" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Acquiring lock "cinder-quobyte-75a2fd55-c364-4a25-8ce3-2383cfb1e741" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Lock "cinder-quobyte-75a2fd55-c364-4a25-8ce3-2383cfb1e741" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Deleting offline snapshot 75a2fd55-c364-4a25-8ce3-2383cfb1e741 of volume d30ba4a5-8549-41c0-934d-9cd819ae0958 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:33:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] snapshot_file for this snap is: volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:33:18 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae72d14a-dd3f-40b6-80cb-7736e9972fd7]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:19 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 Apr 09 13:33:19 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:20 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741" returned: 0 in 1.398s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d30ba4a5-8549-41c0-934d-9cd819ae0958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:33:20 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c10165-0d6e-45a5-8657-c11f221d8355]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:20 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 Apr 09 13:33:20 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:20 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Flow 'volume_create_manager' (05783760-1ee2-4ceb-8c05-0dc504ec4864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49da6b3e-9cf9-43d0-bc8f-f2b9a1deaf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49da6b3e-9cf9-43d0-bc8f-f2b9a1deaf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1710156239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93429acd-afbf-4682-835a-3fd333653967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f060a2ed59d47179d6879bd63fc8eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:21Z,use_quota=True,user_id='c540142424de4076bdb8e9a21bacb62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559e0f4b-3dc5-4930-83d8-571c67f862f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559e0f4b-3dc5-4930-83d8-571c67f862f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd0dfa5-9220-4978-86c1-ad8214206d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd0dfa5-9220-4978-86c1-ad8214206d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93429acd-afbf-4682-835a-3fd333653967', 'volume_name': 'volume-93429acd-afbf-4682-835a-3fd333653967', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a7b62e-bf5f-4bba-afa5-f067c71a81e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a7b62e-bf5f-4bba-afa5-f067c71a81e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783a75b9-27bb-4aa0-933e-5a5da4ead74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:21 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Volume 93429acd-afbf-4682-835a-3fd333653967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93429acd-afbf-4682-835a-3fd333653967', 'volume_size': 1} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1710156239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93429acd-afbf-4682-835a-3fd333653967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f060a2ed59d47179d6879bd63fc8eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:21Z,use_quota=True,user_id='c540142424de4076bdb8e9a21bacb62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Creating volume 93429acd-afbf-4682-835a-3fd333653967 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:21 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:21 devstack sudo[86589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 1073741824 Apr 09 13:33:21 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:21 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958" returned: 0 in 1.102s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:21 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Flow 'volume_create_manager' (d56bfea7-8f57-49c1-9ef4-91027fe6e699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e941393-a436-4cd2-9d37-7a8d82efbfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:21 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e941393-a436-4cd2-9d37-7a8d82efbfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1368701661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4773ca-79f9-452f-b5aa-c7abdcfcef22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3b0064b3c64c5ca54deb375aebac05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:21Z,use_quota=True,user_id='8d2afc97042c44f78539fce188c458b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873a53e5-6ca9-4e5e-8524-8109b86f7067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873a53e5-6ca9-4e5e-8524-8109b86f7067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d19cbb-f6fe-41cb-9f67-b5a9c6539d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d19cbb-f6fe-41cb-9f67-b5a9c6539d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd4773ca-79f9-452f-b5aa-c7abdcfcef22', 'volume_name': 'volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0ab574-9a29-42ea-b85d-db09ea45f02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0ab574-9a29-42ea-b85d-db09ea45f02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ac8c99-2f5a-4328-b6bd-303ae6cf3b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:21 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Volume bd4773ca-79f9-452f-b5aa-c7abdcfcef22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22', 'volume_size': 1} Apr 09 13:33:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:22 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 1073741824" returned: 0 in 1.027s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:22 devstack sudo[86601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 Apr 09 13:33:22 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:22 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741" returned: 0 in 0.759s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:22 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741 Apr 09 13:33:22 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:22 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967" returned: 0 in 0.466s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1368701661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4773ca-79f9-452f-b5aa-c7abdcfcef22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3b0064b3c64c5ca54deb375aebac05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:21Z,use_quota=True,user_id='8d2afc97042c44f78539fce188c458b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Creating volume bd4773ca-79f9-452f-b5aa-c7abdcfcef22 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:22 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783a75b9-27bb-4aa0-933e-5a5da4ead74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93429acd-afbf-4682-835a-3fd333653967', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752864bc-bb12-4b04-becb-227083d00c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:22 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22 1073741824 Apr 09 13:33:22 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:22 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Volume volume-93429acd-afbf-4682-835a-3fd333653967 (93429acd-afbf-4682-835a-3fd333653967): created successfully Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752864bc-bb12-4b04-becb-227083d00c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Flow 'volume_create_manager' (05783760-1ee2-4ceb-8c05-0dc504ec4864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:22 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-5f95bb47-6033-41fd-9d94-512b8e8fcad6 tempest-VolumesSnapshotTestJSON-2134530092 None] Created volume successfully. Apr 09 13:33:22 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958.75a2fd55-c364-4a25-8ce3-2383cfb1e741" returned: 0 in 0.640s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Lock "cinder-quobyte-75a2fd55-c364-4a25-8ce3-2383cfb1e741" released by "_delete_snapshot" :: held 4.000s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Lock "cinder-quobyte-d30ba4a5-8549-41c0-934d-9cd819ae0958" released by "delete_snapshot" :: held 4.018s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:22 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Created reservations ['4296873e-48f0-4156-b543-5491767a69da', '9a6d1027-b125-4c96-b725-4ac6deecd281', 'd0070820-22aa-4bfb-bd28-5c8f76c4b300', 'bf82c80b-b592-4145-b1bb-a0ca49dc37e3'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:23 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Delete snapshot completed successfully. Apr 09 13:33:23 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80c741e5-7b77-4cb2-b2a5-7bfcd439c3bf tempest-SnapshotMetadataTestJSON-98818130 None] Lock "cinder-75a2fd55-c364-4a25-8ce3-2383cfb1e741-delete_snapshot" released by "delete_snapshot" :: held 4.277s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:23 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22 1073741824" returned: 0 in 1.028s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:23 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22 Apr 09 13:33:23 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:24 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22" returned: 0 in 0.424s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.767s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ac8c99-2f5a-4328-b6bd-303ae6cf3b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d6120e-3b8b-4c05-b71d-099bddceff0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] Creating offline snapshot c6ac87f5-c37f-4280-aeda-a89966bbe677 of volume 93429acd-afbf-4682-835a-3fd333653967 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:33:24 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Volume volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22 (bd4773ca-79f9-452f-b5aa-c7abdcfcef22): created successfully Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d6120e-3b8b-4c05-b71d-099bddceff0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Flow 'volume_create_manager' (d56bfea7-8f57-49c1-9ef4-91027fe6e699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65523d2-00b4-4df0-8fd9-fd9a04cad1ed]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:24 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-95f4d25c-0cc8-4b67-a2ad-61747f028779 tempest-VolumesTransfersV357Test-2030937695 None] Created volume successfully. Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Acquiring lock "cinder-d30ba4a5-8549-41c0-934d-9cd819ae0958-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Lock "cinder-d30ba4a5-8549-41c0-934d-9cd819ae0958-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:24 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 Apr 09 13:33:24 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Acquiring lock "cinder-quobyte-d30ba4a5-8549-41c0-934d-9cd819ae0958" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Lock "cinder-quobyte-d30ba4a5-8549-41c0-934d-9cd819ae0958" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30ee24d-256b-4285-b6df-2de5f1400bf7]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:24 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 Apr 09 13:33:24 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:24 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967" returned: 0 in 0.689s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:24 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 1G Apr 09 13:33:24 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:25 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958" returned: 0 in 0.706s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:25 devstack sudo[86651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958 Apr 09 13:33:25 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:25 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f88fb98f-b558-41ac-9472-376c36094e19 tempest-VolumesTransfersV357Test-1245349357 None] Transfer volume completed successfully. Apr 09 13:33:25 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 1G" returned: 0 in 0.755s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93429acd-afbf-4682-835a-3fd333653967 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:25 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93429acd-afbf-4682-835a-3fd333653967 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 Apr 09 13:33:25 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:26 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d30ba4a5-8549-41c0-934d-9cd819ae0958" returned: 0 in 1.158s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Lock "cinder-quobyte-d30ba4a5-8549-41c0-934d-9cd819ae0958" released by "delete_volume" :: held 1.949s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Acquiring lock "cinder-bd4773ca-79f9-452f-b5aa-c7abdcfcef22-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Lock "cinder-bd4773ca-79f9-452f-b5aa-c7abdcfcef22-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Created reservations ['5dfb3ef0-404b-418e-b25f-f5c5a4f531cb', '83170922-1c9d-48e8-b144-711b97742fec', 'a829f53b-a607-486f-af82-d36f154464e1', '6be04c22-ac34-4270-a3e2-437c845a6248'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Acquiring lock "cinder-quobyte-bd4773ca-79f9-452f-b5aa-c7abdcfcef22" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Lock "cinder-quobyte-bd4773ca-79f9-452f-b5aa-c7abdcfcef22" acquired by "delete_volume" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:26 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93429acd-afbf-4682-835a-3fd333653967 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677" returned: 0 in 0.940s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:26 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 is being set with open permissions: ugo+rw Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[142a3898-058c-4b24-9d4f-84b4316e7767]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:26 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 Apr 09 13:33:26 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:26 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:26 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:26 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22 Apr 09 13:33:26 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:27 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.988s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:27 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:27 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Deleted volume successfully. Apr 09 13:33:27 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=97,cinder:INSERT=37,cinder:UPDATE=114,cinder:DELETE=10 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:33:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-253a9934-92d3-4eda-809d-1ac57163d568 tempest-SnapshotMetadataTestJSON-98818130 None] Lock "cinder-d30ba4a5-8549-41c0-934d-9cd819ae0958-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:28 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22" returned: 0 in 1.513s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Acquiring lock "cinder-8327fcb4-498f-4d80-a777-204b4b3d18a6-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Lock "cinder-8327fcb4-498f-4d80-a777-204b4b3d18a6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:28 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22 Apr 09 13:33:28 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:28 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:UPDATE=162,cinder:SELECT=114,cinder:DELETE=15,cinder:INSERT=31 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:33:28 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Acquiring lock "cinder-quobyte-8327fcb4-498f-4d80-a777-204b4b3d18a6" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677" returned: 0 in 1.662s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Lock "cinder-quobyte-8327fcb4-498f-4d80-a777-204b4b3d18a6" acquired by "delete_volume" :: waited 0.059s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:28 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[96755132-1163-4da2-9fbb-1a96a79d8a23]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:28 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.info Apr 09 13:33:28 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:28 devstack sudo[86737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6 Apr 09 13:33:28 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:29 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6" returned: 0 in 0.980s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:29 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6 Apr 09 13:33:29 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:29 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.info" returned: 0 in 1.145s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:29 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.info is being set with open permissions: ugo+rw Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:29 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.info Apr 09 13:33:29 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:29 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd4773ca-79f9-452f-b5aa-c7abdcfcef22" returned: 0 in 1.468s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Lock "cinder-quobyte-bd4773ca-79f9-452f-b5aa-c7abdcfcef22" released by "delete_volume" :: held 3.043s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Created reservations ['b228905b-ed70-4739-bb12-97214d44176e', 'b90bdfe6-6696-4570-ab25-783bf78c71d8', '9e743466-709e-4af2-94a8-b5ea6396bd40', '294782f4-2642-4687-9d2a-449c8db92fde'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:29 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:29 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:30 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8327fcb4-498f-4d80-a777-204b4b3d18a6" returned: 0 in 1.307s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:30 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Flow 'volume_create_manager' (ba863221-4307-43ca-b877-ab13a8e4056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f5de7b-2d71-4819-ac10-d0b77f2de0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.info" returned: 0 in 1.193s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.589s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Lock "cinder-quobyte-8327fcb4-498f-4d80-a777-204b4b3d18a6" released by "delete_volume" :: held 2.440s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f5de7b-2d71-4819-ac10-d0b77f2de0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-429919455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909d0948-a497-456f-873b-72f127e7fd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3b0064b3c64c5ca54deb375aebac05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:30Z,use_quota=True,user_id='8d2afc97042c44f78539fce188c458b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47b88f5-5e93-438f-a08a-cbe7871a17c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47b88f5-5e93-438f-a08a-cbe7871a17c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64151772-a126-41ca-a998-9514cf8cd9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64151772-a126-41ca-a998-9514cf8cd9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909d0948-a497-456f-873b-72f127e7fd76', 'volume_name': 'volume-909d0948-a497-456f-873b-72f127e7fd76', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1912c066-2ffe-4172-9867-c429f325ac5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1912c066-2ffe-4172-9867-c429f325ac5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb348a6d-2917-4365-a430-ee922f073fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:30 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Volume 909d0948-a497-456f-873b-72f127e7fd76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909d0948-a497-456f-873b-72f127e7fd76', 'volume_size': 1} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-429919455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909d0948-a497-456f-873b-72f127e7fd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3b0064b3c64c5ca54deb375aebac05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:30Z,use_quota=True,user_id='8d2afc97042c44f78539fce188c458b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Creating volume 909d0948-a497-456f-873b-72f127e7fd76 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:30 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:30 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76 1073741824 Apr 09 13:33:30 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:30 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-4cc77678-2270-4914-bb03-4c4bbdc152ae tempest-VolumesSnapshotTestJSON-2134530092 None] Create snapshot completed successfully Apr 09 13:33:30 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Created reservations ['2a58a0b5-ea96-495e-8640-24cf998524cb', 'a3d88d81-d73f-4f8a-b46c-e62d5da5456a', 'c2205332-80ff-41ff-bd8c-4c7d52c49d43', 'd6fb4116-d6dd-4611-a290-11795cca7985'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:31 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 1.268s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:31 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:31 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Deleted volume successfully. Apr 09 13:33:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f853b72-9bb7-483c-8715-8593db07eef2 tempest-VolumesTransfersV357Test-309609681 None] Lock "cinder-bd4773ca-79f9-452f-b5aa-c7abdcfcef22-delete_volume" released by "delete_volume" :: held 4.771s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:31 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:31 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:31 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76 1073741824" returned: 0 in 1.110s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:32 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76 Apr 09 13:33:32 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-c6ac87f5-c37f-4280-aeda-a89966bbe677-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:32 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-c6ac87f5-c37f-4280-aeda-a89966bbe677-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 1.049s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-93429acd-afbf-4682-835a-3fd333653967" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:32 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Deleted volume successfully. Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-93429acd-afbf-4682-835a-3fd333653967" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-c6ac87f5-c37f-4280-aeda-a89966bbe677" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-7e0b7c0d-8c68-4185-9fe4-74b3484f18c1 tempest-ServerRescueNegativeTestJSON-838222255 None] Lock "cinder-8327fcb4-498f-4d80-a777-204b4b3d18a6-delete_volume" released by "delete_volume" :: held 4.079s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-c6ac87f5-c37f-4280-aeda-a89966bbe677" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Deleting offline snapshot c6ac87f5-c37f-4280-aeda-a89966bbe677 of volume 93429acd-afbf-4682-835a-3fd333653967 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] snapshot_file for this snap is: volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33e4dc1-10a2-434d-8efe-37b5bb2cdb5d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:32 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 Apr 09 13:33:32 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:32 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76" returned: 0 in 0.874s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb348a6d-2917-4365-a430-ee922f073fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909d0948-a497-456f-873b-72f127e7fd76', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b509f42-b3ce-4ed0-8014-ca9a25332f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:32 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Volume volume-909d0948-a497-456f-873b-72f127e7fd76 (909d0948-a497-456f-873b-72f127e7fd76): created successfully Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b509f42-b3ce-4ed0-8014-ca9a25332f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Flow 'volume_create_manager' (ba863221-4307-43ca-b877-ab13a8e4056a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:32 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-49f1f2f8-498a-483e-b817-952c5c4369fa tempest-VolumesTransfersV357Test-2030937695 None] Created volume successfully. Apr 09 13:33:33 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677" returned: 0 in 0.895s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93429acd-afbf-4682-835a-3fd333653967(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d41066-522a-4763-b941-b7b795aa9e46]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:33 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 Apr 09 13:33:33 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_service.periodic_task [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82346) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:33 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:33 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Flow 'volume_create_manager' (287f4c0d-26ad-4f26-bd4d-27ea03470125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761bdefb-3690-4af6-9048-aed301e4988c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761bdefb-3690-4af6-9048-aed301e4988c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-133371483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a51b27a-2706-41c6-b7f0-5bd875d31a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5db446259a4b1485e4642472a3d567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:33Z,use_quota=True,user_id='4b60cb9698d944f4b460cde372ee7391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3677cab8-c63c-41f4-81ab-25f33a38f557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3677cab8-c63c-41f4-81ab-25f33a38f557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be273e21-2ecd-41e2-b604-eef8fcd0540b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be273e21-2ecd-41e2-b604-eef8fcd0540b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a51b27a-2706-41c6-b7f0-5bd875d31a6c', 'volume_name': 'volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30834b40-56e6-4324-a377-4edd30069e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30834b40-56e6-4324-a377-4edd30069e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb1604e-de0f-44a9-8df4-387bc4b3dc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:33 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Volume 1a51b27a-2706-41c6-b7f0-5bd875d31a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c', 'volume_size': 1} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-133371483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a51b27a-2706-41c6-b7f0-5bd875d31a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5db446259a4b1485e4642472a3d567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:33Z,use_quota=True,user_id='4b60cb9698d944f4b460cde372ee7391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Creating volume 1a51b27a-2706-41c6-b7f0-5bd875d31a6c {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:33 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:33 devstack sudo[86812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c 1073741824 Apr 09 13:33:33 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:33 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967" returned: 0 in 0.568s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:33 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 Apr 09 13:33:33 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:33 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.485s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:33 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:34 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c 1073741824" returned: 0 in 0.616s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:34 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Acquiring lock "cinder-909d0948-a497-456f-873b-72f127e7fd76-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:34 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Lock "cinder-909d0948-a497-456f-873b-72f127e7fd76-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Acquiring lock "cinder-quobyte-909d0948-a497-456f-873b-72f127e7fd76" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Lock "cinder-quobyte-909d0948-a497-456f-873b-72f127e7fd76" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8e07ff-80b4-43f9-b5a3-78624a6d56a3]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:34 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677" returned: 0 in 0.800s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:34 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677 Apr 09 13:33:34 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:34 devstack sudo[86830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76 Apr 09 13:33:34 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:34 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c" returned: 0 in 0.611s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb1604e-de0f-44a9-8df4-387bc4b3dc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3f8872-d105-4bf7-857a-1e6070190c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:34 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Volume volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c (1a51b27a-2706-41c6-b7f0-5bd875d31a6c): created successfully Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3f8872-d105-4bf7-857a-1e6070190c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Flow 'volume_create_manager' (287f4c0d-26ad-4f26-bd4d-27ea03470125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:34 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f29f8f2f-7433-40af-b602-3096adf6bf65 tempest-AbsoluteLimitsTests-1627799040 None] Created volume successfully. Apr 09 13:33:34 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967.c6ac87f5-c37f-4280-aeda-a89966bbe677" returned: 0 in 0.450s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-c6ac87f5-c37f-4280-aeda-a89966bbe677" released by "_delete_snapshot" :: held 2.790s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-93429acd-afbf-4682-835a-3fd333653967" released by "delete_snapshot" :: held 2.806s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:34 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76" returned: 0 in 0.598s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:35 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76 Apr 09 13:33:35 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Created reservations ['0f82e2ef-ed0c-440c-a93b-3bbf1313c222', 'f1e6b191-ccb2-43d2-b7bf-d8e5f48d8abd', '0402651e-e90d-4592-b01a-bf64ee72ed54', '9bcb56d3-9279-4cfd-ae3d-39100abe15c8'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Delete snapshot completed successfully. Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-63ef4cdf-d6f9-4b58-ac1d-017aa309067e tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-c6ac87f5-c37f-4280-aeda-a89966bbe677-delete_snapshot" released by "delete_snapshot" :: held 2.969s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:35 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-909d0948-a497-456f-873b-72f127e7fd76" returned: 0 in 0.542s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Lock "cinder-quobyte-909d0948-a497-456f-873b-72f127e7fd76" released by "delete_volume" :: held 1.166s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Created reservations ['4c575759-a4fb-4e0f-af2c-c045e5073e5d', '031e164c-3846-4afb-b206-cfe7e0e76829', '366b5a3d-f77a-4233-9722-b528e74b96e5', '0cd9f7ed-b61d-4b3a-b982-a9dd7cab4128'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:35 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:35 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Flow 'volume_create_manager' (80e55441-bddb-4bbc-91ac-170bd2caf627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8897c7-5052-46d8-84d9-eff4e23ec0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Acquiring lock "cinder-1a51b27a-2706-41c6-b7f0-5bd875d31a6c-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8897c7-5052-46d8-84d9-eff4e23ec0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1262990757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3849fbc4-7fef-4da0-9807-ed2b641b7367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f060a2ed59d47179d6879bd63fc8eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:36Z,use_quota=True,user_id='c540142424de4076bdb8e9a21bacb62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31281e4-eceb-40fe-ab02-460e76670cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31281e4-eceb-40fe-ab02-460e76670cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09823d3-da47-4ecd-ab6b-f23adadb3c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09823d3-da47-4ecd-ab6b-f23adadb3c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3849fbc4-7fef-4da0-9807-ed2b641b7367', 'volume_name': 'volume-3849fbc4-7fef-4da0-9807-ed2b641b7367', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3e81d7-07db-4707-9321-41096a6703e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3e81d7-07db-4707-9321-41096a6703e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1deebc94-4ff1-4f71-8be1-1a03ac5fb0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:35 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Volume 3849fbc4-7fef-4da0-9807-ed2b641b7367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3849fbc4-7fef-4da0-9807-ed2b641b7367', 'volume_size': 1} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1262990757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3849fbc4-7fef-4da0-9807-ed2b641b7367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f060a2ed59d47179d6879bd63fc8eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:36Z,use_quota=True,user_id='c540142424de4076bdb8e9a21bacb62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Creating volume 3849fbc4-7fef-4da0-9807-ed2b641b7367 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:35 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Lock "cinder-1a51b27a-2706-41c6-b7f0-5bd875d31a6c-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:35 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 1073741824 Apr 09 13:33:35 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Acquiring lock "cinder-quobyte-1a51b27a-2706-41c6-b7f0-5bd875d31a6c" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Lock "cinder-quobyte-1a51b27a-2706-41c6-b7f0-5bd875d31a6c" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd8048e-6417-4ac8-a2ff-52cd9939f87d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:36 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c Apr 09 13:33:36 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:36 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.589s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:36 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:36 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Deleted volume successfully. Apr 09 13:33:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-88efbaf5-3f49-430e-a56d-c2dda0304aee tempest-VolumesTransfersV357Test-309609681 None] Lock "cinder-909d0948-a497-456f-873b-72f127e7fd76-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:36 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 1073741824" returned: 0 in 0.618s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:36 devstack sudo[86856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 Apr 09 13:33:36 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:36 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c" returned: 0 in 0.656s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:36 devstack sudo[86858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c Apr 09 13:33:36 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:37 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367" returned: 0 in 0.614s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1deebc94-4ff1-4f71-8be1-1a03ac5fb0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3849fbc4-7fef-4da0-9807-ed2b641b7367', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c9cbd1-c9a9-40d1-9d25-0d7b226b3b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:37 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Volume volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 (3849fbc4-7fef-4da0-9807-ed2b641b7367): created successfully Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c9cbd1-c9a9-40d1-9d25-0d7b226b3b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Flow 'volume_create_manager' (80e55441-bddb-4bbc-91ac-170bd2caf627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:37 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a51b27a-2706-41c6-b7f0-5bd875d31a6c" returned: 0 in 0.556s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:37 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-979cf9bb-da09-4404-912a-d9d25978ba62 tempest-VolumesSnapshotTestJSON-2134530092 None] Created volume successfully. Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Lock "cinder-quobyte-1a51b27a-2706-41c6-b7f0-5bd875d31a6c" released by "delete_volume" :: held 1.242s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Created reservations ['54921e47-a263-4cf9-a0b5-d5ef73f7b1dc', '2cc4dab5-2103-4af3-89ab-045b51a159b3', '93b0f783-7a72-4499-b0cc-b7c721613968', '72cbb319-347d-4b42-9293-2f6164bfd285'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:37 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:37 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:37 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.584s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:37 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Deleted volume successfully. Apr 09 13:33:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-12c97f17-d38d-47f9-b3a4-b5c43f92c263 tempest-AbsoluteLimitsTests-1627799040 None] Lock "cinder-1a51b27a-2706-41c6-b7f0-5bd875d31a6c-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] Creating offline snapshot db1355a4-e81b-4eb1-974f-4aa72f9a1a21 of volume 3849fbc4-7fef-4da0-9807-ed2b641b7367 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:33:38 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[de32193f-11fc-4418-bc80-be2f3f2307c9]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:38 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 Apr 09 13:33:38 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:38 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367" returned: 0 in 0.757s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:39 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 1G Apr 09 13:33:39 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:39 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 1G" returned: 0 in 0.765s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:39 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 Apr 09 13:33:39 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:40 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21" returned: 0 in 0.632s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:40 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 is being set with open permissions: ugo+rw Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:40 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 Apr 09 13:33:40 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Flow 'volume_create_manager' (15d511e9-5177-4eb0-8c87-06725af5901b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e326d7c-4869-4a0b-bcf0-2ffcc4532be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e326d7c-4869-4a0b-bcf0-2ffcc4532be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1547607120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f6c09e-1894-4786-a1ae-7b225f66bef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9bfe88c65d4c42bafa426a50eca196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:41Z,use_quota=True,user_id='8a2824bffddb418b889408508ea54b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2ead0f-2c80-419a-8820-3b0e7c607028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2ead0f-2c80-419a-8820-3b0e7c607028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6585033-7233-4f31-855d-5e9cd6a7c4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6585033-7233-4f31-855d-5e9cd6a7c4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79f6c09e-1894-4786-a1ae-7b225f66bef7', 'volume_name': 'volume-79f6c09e-1894-4786-a1ae-7b225f66bef7', 'volume_size': 2}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a504bb1-50fb-49ae-93e5-bdc09e72865e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a504bb1-50fb-49ae-93e5-bdc09e72865e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:41 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2763538f-eaa6-4273-8886-e895646ece31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:41 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Volume 79f6c09e-1894-4786-a1ae-7b225f66bef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79f6c09e-1894-4786-a1ae-7b225f66bef7', 'volume_size': 2} Apr 09 13:33:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:41 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21" returned: 0 in 0.743s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:41 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.info Apr 09 13:33:41 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:41 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.info" returned: 0 in 0.466s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:41 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.info is being set with open permissions: ugo+rw Apr 09 13:33:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:41 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.info Apr 09 13:33:41 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:42 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.info" returned: 0 in 0.521s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.959s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1547607120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f6c09e-1894-4786-a1ae-7b225f66bef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f9bfe88c65d4c42bafa426a50eca196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:41Z,use_quota=True,user_id='8a2824bffddb418b889408508ea54b88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Creating volume 79f6c09e-1894-4786-a1ae-7b225f66bef7 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:42 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7 2147483648 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:42 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7 2147483648 Apr 09 13:33:42 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:42 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-9a4b56bd-8432-411f-afca-2e8328ca332d tempest-VolumesSnapshotTestJSON-2134530092 None] Create snapshot completed successfully Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Flow 'volume_create_manager' (bcdd02ad-3a2a-4600-9ec6-4a1ccea21a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900d26ee-64c3-4a59-8e18-94065f53d0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900d26ee-64c3-4a59-8e18-94065f53d0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-51296400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99369a0-104c-43bf-8728-ff34a925ed91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f060a2ed59d47179d6879bd63fc8eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=db1355a4-e81b-4eb1-974f-4aa72f9a1a21,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:43Z,use_quota=True,user_id='c540142424de4076bdb8e9a21bacb62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd60acf5-9ce8-4585-bc1d-c9b77c31d23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd60acf5-9ce8-4585-bc1d-c9b77c31d23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4caea8-c924-4b05-842a-401052106cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4caea8-c924-4b05-842a-401052106cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e99369a0-104c-43bf-8728-ff34a925ed91', 'volume_name': 'volume-e99369a0-104c-43bf-8728-ff34a925ed91', 'volume_size': 2, 'snapshot_id': 'db1355a4-e81b-4eb1-974f-4aa72f9a1a21'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935893f3-9f01-41f2-82f7-be333a868731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935893f3-9f01-41f2-82f7-be333a868731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cd129d-1090-4942-9085-a0a7525d66fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:42 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Volume e99369a0-104c-43bf-8728-ff34a925ed91: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e99369a0-104c-43bf-8728-ff34a925ed91', 'volume_size': 2, 'snapshot_id': 'db1355a4-e81b-4eb1-974f-4aa72f9a1a21'} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:42 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7 2147483648" returned: 0 in 0.634s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:42 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7 Apr 09 13:33:42 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:43 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7" returned: 0 in 0.484s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.579s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-db1355a4-e81b-4eb1-974f-4aa72f9a1a21-e99369a0-104c-43bf-8728-ff34a925ed91" by "_create_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2763538f-eaa6-4273-8886-e895646ece31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79f6c09e-1894-4786-a1ae-7b225f66bef7', 'volume_size': 2}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8470c65-e732-4bbc-9f73-4ef8c17f8c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-db1355a4-e81b-4eb1-974f-4aa72f9a1a21-e99369a0-104c-43bf-8728-ff34a925ed91" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Creating volume e99369a0-104c-43bf-8728-ff34a925ed91 from snapshot db1355a4-e81b-4eb1-974f-4aa72f9a1a21 {{(pid=82346) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-e99369a0-104c-43bf-8728-ff34a925ed91" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:43 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Volume volume-79f6c09e-1894-4786-a1ae-7b225f66bef7 (79f6c09e-1894-4786-a1ae-7b225f66bef7): created successfully Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8470c65-e732-4bbc-9f73-4ef8c17f8c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Flow 'volume_create_manager' (15d511e9-5177-4eb0-8c87-06725af5901b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:43 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-52a94695-4f71-43fe-bd50-9014fb727cfe tempest-VolumesCloneNegativeTest-657924644 None] Created volume successfully. Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-e99369a0-104c-43bf-8728-ff34a925ed91" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] snapshot: db1355a4-e81b-4eb1-974f-4aa72f9a1a21, volume: e99369a0-104c-43bf-8728-ff34a925ed91, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3063cb69-4551-4e9b-8dad-1d26e6be4ec9]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:43 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 Apr 09 13:33:43 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:43 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21" returned: 0 in 0.532s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3849fbc4-7fef-4da0-9807-ed2b641b7367(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[428af3e8-00c9-493b-be32-1fbc59202c25]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:44 devstack sudo[86935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 Apr 09 13:33:44 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Acquiring lock "cinder-79f6c09e-1894-4786-a1ae-7b225f66bef7-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Lock "cinder-79f6c09e-1894-4786-a1ae-7b225f66bef7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Acquiring lock "cinder-quobyte-79f6c09e-1894-4786-a1ae-7b225f66bef7" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Lock "cinder-quobyte-79f6c09e-1894-4786-a1ae-7b225f66bef7" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:44 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d1562e-9047-42e7-b278-9473c36055eb]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:44 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7 Apr 09 13:33:44 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:44 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367" returned: 0 in 0.605s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:44 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:33:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:44 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91 Apr 09 13:33:44 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:44 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7" returned: 0 in 0.626s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:44 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7 Apr 09 13:33:44 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:46 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79f6c09e-1894-4786-a1ae-7b225f66bef7" returned: 0 in 1.432s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:46 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Lock "cinder-quobyte-79f6c09e-1894-4786-a1ae-7b225f66bef7" released by "delete_volume" :: held 2.095s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:46 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Created reservations ['f61e6362-8330-40c5-8880-aa7a3d6afefe', '23a80b18-28b9-499a-937a-feba8778b563', '580f6d03-7be7-4012-9953-93e98ab5cc24', 'f730c9e0-86f0-401b-9b16-8360fe62db52'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:46 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:46 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:46 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:46 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:47 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91" returned: 0 in 2.545s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:47 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0ceedd-6cbf-48bf-87a4-e8b8c8d65553]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:47 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 Apr 09 13:33:47 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:47 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.548s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:47 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:47 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Deleted volume successfully. Apr 09 13:33:47 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-85e9bbcc-bf5d-4854-a670-929039d883c6 tempest-VolumesCloneNegativeTest-657924644 None] Lock "cinder-79f6c09e-1894-4786-a1ae-7b225f66bef7-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:47 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367" returned: 0 in 0.656s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:47 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367, size 1024.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:33:47 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Converted 1024.00 MB image at 402.12 MB/s Apr 09 13:33:47 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91 is being set with open permissions: ugo+rw Apr 09 13:33:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:47 devstack sudo[86978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91 Apr 09 13:33:47 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:48 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91" returned: 0 in 0.568s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-e99369a0-104c-43bf-8728-ff34a925ed91" released by "_copy_volume_from_snapshot" :: held 4.984s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-db1355a4-e81b-4eb1-974f-4aa72f9a1a21-e99369a0-104c-43bf-8728-ff34a925ed91" released by "_create_volume_from_snapshot" :: held 5.021s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.048s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:48 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cd129d-1090-4942-9085-a0a7525d66fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e99369a0-104c-43bf-8728-ff34a925ed91', 'volume_size': 2, 'snapshot_id': 'db1355a4-e81b-4eb1-974f-4aa72f9a1a21'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:48 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08856773-2bee-43aa-8ebb-7c6a17b32ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:48 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Volume volume-e99369a0-104c-43bf-8728-ff34a925ed91 (e99369a0-104c-43bf-8728-ff34a925ed91): created successfully Apr 09 13:33:48 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08856773-2bee-43aa-8ebb-7c6a17b32ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:48 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Flow 'volume_create_manager' (bcdd02ad-3a2a-4600-9ec6-4a1ccea21a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:48 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-04bfda8d-9859-4811-8d93-39902f6ddd52 tempest-VolumesSnapshotTestJSON-2134530092 None] Created volume successfully. Apr 09 13:33:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-e99369a0-104c-43bf-8728-ff34a925ed91-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-e99369a0-104c-43bf-8728-ff34a925ed91-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-e99369a0-104c-43bf-8728-ff34a925ed91" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-e99369a0-104c-43bf-8728-ff34a925ed91" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:49 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f8d18a-4f1b-4b5a-b9ca-3deedc77dcf4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:49 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91 Apr 09 13:33:49 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:50 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91" returned: 0 in 0.757s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:50 devstack sudo[86989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91 Apr 09 13:33:50 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Flow 'volume_create_manager' (25b4d2df-89b9-4eb4-ba2b-594d2133431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d5450e-5d78-4f4f-a372-e4dd7d32b982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d5450e-5d78-4f4f-a372-e4dd7d32b982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2038027981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704061ae-1ddc-4c09-b8cd-db68d4a86f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd95eae6a8a4d5bad88bdb8f8c455e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:51Z,use_quota=True,user_id='4d225eaaea8540f797eb4bfe4af9ab5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb11e00-4cc4-4af1-8bae-d714a6a9e331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb11e00-4cc4-4af1-8bae-d714a6a9e331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7830dc7-b7d4-47f2-8c28-8888a0184d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:50 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.image.glance [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Creating Keystone auth plugin from conf {{(pid=82346) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e99369a0-104c-43bf-8728-ff34a925ed91" returned: 0 in 0.636s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-e99369a0-104c-43bf-8728-ff34a925ed91" released by "delete_volume" :: held 1.447s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Created reservations ['b70e4a0f-2a6c-442d-b06d-911116f0d780', '64374c36-c572-44a9-988f-579d1e88dc46', '85cb5b6f-6f7f-43a3-9067-b169a5f27120', 'ca6b5748-269c-447d-8910-006089065e5d'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:50 devstack sudo[86992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:50 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7830dc7-b7d4-47f2-8c28-8888a0184d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '704061ae-1ddc-4c09-b8cd-db68d4a86f63', 'volume_name': 'volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d0ab3e-51f7-4148-b2ba-c33fdc9e5e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d0ab3e-51f7-4148-b2ba-c33fdc9e5e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3929bb-a272-462b-aeb6-803b99cbee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:51 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Volume 704061ae-1ddc-4c09-b8cd-db68d4a86f63: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Trying to clone 704061ae-1ddc-4c09-b8cd-db68d4a86f63 from image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e at location (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]). {{(pid=82346) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 13:33:51 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Image download 20.69 MB at 20.69 MB/s Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a007eaea-c62e-480c-a23d-6c8425a44763]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:51 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD Apr 09 13:33:51 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:51 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.580s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:51 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Deleted volume successfully. Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f2c09e10-25a1-4914-b947-f2ed7403116b tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-e99369a0-104c-43bf-8728-ff34a925ed91-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-db1355a4-e81b-4eb1-974f-4aa72f9a1a21-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-db1355a4-e81b-4eb1-974f-4aa72f9a1a21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-3849fbc4-7fef-4da0-9807-ed2b641b7367" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-3849fbc4-7fef-4da0-9807-ed2b641b7367" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-db1355a4-e81b-4eb1-974f-4aa72f9a1a21" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-db1355a4-e81b-4eb1-974f-4aa72f9a1a21" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Deleting offline snapshot db1355a4-e81b-4eb1-974f-4aa72f9a1a21 of volume 3849fbc4-7fef-4da0-9807-ed2b641b7367 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] snapshot_file for this snap is: volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe845b4-1123-480d-94ac-41d1648b6288]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:51 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 Apr 09 13:33:51 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:52 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Temporary image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e is fetched for user 4d225eaaea8540f797eb4bfe4af9ab5c. {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9559e13-b71e-4d5e-9bd0-6b1dfeaaaafb]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:52 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD Apr 09 13:33:52 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:52 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Flow 'volume_create_manager' (5e5b69df-c6d2-4205-bccb-1f0ddee3c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2e1e9a-c554-4b03-9c38-9c14086b6bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21" returned: 0 in 0.757s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3849fbc4-7fef-4da0-9807-ed2b641b7367(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2e1e9a-c554-4b03-9c38-9c14086b6bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-871050633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b7d09e-1398-4170-b052-39c1384574ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c36a67488d48b8a25806f4653513d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:52Z,use_quota=True,user_id='3e5a0996d4ae4eabbeadc099b09d87a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566e9e26-a18b-4e13-bcf1-94e214c00d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566e9e26-a18b-4e13-bcf1-94e214c00d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605fbeae-1e0d-4da6-bd49-42e9875d343f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605fbeae-1e0d-4da6-bd49-42e9875d343f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b7d09e-1398-4170-b052-39c1384574ae', 'volume_name': 'volume-33b7d09e-1398-4170-b052-39c1384574ae', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c505660e-6977-4a93-b3d9-4329d32a1157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c505660e-6977-4a93-b3d9-4329d32a1157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2619991c-99e4-4cbe-a278-7b7a9b243bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:52 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Volume 33b7d09e-1398-4170-b052-39c1384574ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b7d09e-1398-4170-b052-39c1384574ae', 'volume_size': 1} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-871050633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b7d09e-1398-4170-b052-39c1384574ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c36a67488d48b8a25806f4653513d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:52Z,use_quota=True,user_id='3e5a0996d4ae4eabbeadc099b09d87a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Creating volume 33b7d09e-1398-4170-b052-39c1384574ae {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:52 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9686752c-8fb2-4786-b1a1-678ef350f242]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:52 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae 1073741824 Apr 09 13:33:52 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:52 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 Apr 09 13:33:52 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Flow 'volume_create_manager' (e775756e-d88d-4da1-80b2-e19ff9cc284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7bdd75-f781-4a11-9166-d9f2605ca83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7bdd75-f781-4a11-9166-d9f2605ca83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-352245026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f917618-c0c2-4dd6-a653-7ef97e69eb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f811c3eb113d49c680a8d84be3c534b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:53Z,use_quota=True,user_id='bd84ecb6bba24c879daad7ac2d98f8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc633bbc-9fbb-44ea-b88b-3d1a5283f2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc633bbc-9fbb-44ea-b88b-3d1a5283f2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd91fc3-3978-43ef-b59b-7e910dee3f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd91fc3-3978-43ef-b59b-7e910dee3f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f917618-c0c2-4dd6-a653-7ef97e69eb77', 'volume_name': 'volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796c702a-8c00-45ba-8d1d-fe7c70252fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796c702a-8c00-45ba-8d1d-fe7c70252fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c643709-daac-4d2f-9841-59f9f45c0c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:52 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Volume 4f917618-c0c2-4dd6-a653-7ef97e69eb77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77', 'volume_size': 1} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:52 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD" returned: 0 in 0.641s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:53 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367" returned: 0 in 0.582s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:53 devstack sudo[87055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 Apr 09 13:33:53 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:53 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae 1073741824" returned: 0 in 0.666s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:53 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae Apr 09 13:33:53 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:53 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21" returned: 0 in 0.475s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:53 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21 Apr 09 13:33:53 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:53 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae" returned: 0 in 0.429s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.836s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-352245026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f917618-c0c2-4dd6-a653-7ef97e69eb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f811c3eb113d49c680a8d84be3c534b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:53Z,use_quota=True,user_id='bd84ecb6bba24c879daad7ac2d98f8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Creating volume 4f917618-c0c2-4dd6-a653-7ef97e69eb77 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:53 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2619991c-99e4-4cbe-a278-7b7a9b243bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b7d09e-1398-4170-b052-39c1384574ae', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:53 devstack sudo[87065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 1073741824 Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de38746c-51e6-4f84-8737-6a5f4fb3eaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:53 devstack sudo[87065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:53 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Volume volume-33b7d09e-1398-4170-b052-39c1384574ae (33b7d09e-1398-4170-b052-39c1384574ae): created successfully Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de38746c-51e6-4f84-8737-6a5f4fb3eaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Flow 'volume_create_manager' (5e5b69df-c6d2-4205-bccb-1f0ddee3c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:53 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-9567a23b-e2e6-4e2c-b663-c09b05fc8d42 req-24378ec6-26ae-4d80-97ad-4894af646274 tempest-VolumesSnapshotsTestJSON-1853353540 None] Created volume successfully. Apr 09 13:33:53 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367.db1355a4-e81b-4eb1-974f-4aa72f9a1a21" returned: 0 in 0.443s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-db1355a4-e81b-4eb1-974f-4aa72f9a1a21" released by "_delete_snapshot" :: held 2.366s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-3849fbc4-7fef-4da0-9807-ed2b641b7367" released by "delete_snapshot" :: held 2.391s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Created reservations ['60751605-4a43-4104-9a27-31a6bcab7e3b', '4fef931b-5cc4-449b-a434-72f1f9fb74a5', 'a537f763-2de0-42a5-9c17-ba94a8c45f9c', 'ce914b5f-a88c-4caf-96c7-238e9cff97bd'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:54 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Delete snapshot completed successfully. Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-daef918b-0d41-4a38-91e0-77b6460f5bf9 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-db1355a4-e81b-4eb1-974f-4aa72f9a1a21-delete_snapshot" released by "delete_snapshot" :: held 2.484s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:54 devstack sudo[87065]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 1073741824" returned: 0 in 0.517s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:54 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 Apr 09 13:33:54 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:54 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77" returned: 0 in 0.441s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.770s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2038027981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704061ae-1ddc-4c09-b8cd-db68d4a86f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd95eae6a8a4d5bad88bdb8f8c455e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:51Z,use_quota=True,user_id='4d225eaaea8540f797eb4bfe4af9ab5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Creating volume 704061ae-1ddc-4c09-b8cd-db68d4a86f63 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:54 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c643709-daac-4d2f-9841-59f9f45c0c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:54 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 1073741824 Apr 09 13:33:54 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f000f397-f910-46dd-87f9-b1b32dedb1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:54 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Volume volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 (4f917618-c0c2-4dd6-a653-7ef97e69eb77): created successfully Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f000f397-f910-46dd-87f9-b1b32dedb1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Flow 'volume_create_manager' (e775756e-d88d-4da1-80b2-e19ff9cc284a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:54 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-00b34915-5ff1-48a5-a029-b1181684a9c1 tempest-VolumesActionsTest-1792904640 None] Created volume successfully. Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-3849fbc4-7fef-4da0-9807-ed2b641b7367-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-3849fbc4-7fef-4da0-9807-ed2b641b7367-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-3849fbc4-7fef-4da0-9807-ed2b641b7367" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-3849fbc4-7fef-4da0-9807-ed2b641b7367" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cce521a-d4bf-418d-9bb5-2e1a633365d9]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:55 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 Apr 09 13:33:55 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:55 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 1073741824" returned: 0 in 0.648s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:55 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 Apr 09 13:33:55 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:55 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367" returned: 0 in 0.568s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:55 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367 Apr 09 13:33:55 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:55 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63" returned: 0 in 0.474s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.990s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Attempting download of eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e ((None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}])) to volume 704061ae-1ddc-4c09-b8cd-db68d4a86f63. {{(pid=82346) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] Creating offline snapshot 1e5b9967-a4be-412c-80d7-07164496a107 of volume 33b7d09e-1398-4170-b052-39c1384574ae {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c7daf2-8b77-4a04-b7f2-55961e0b875b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fb7510-250f-4209-a058-ce50c8ecc370]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_mvnr74g9 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:55 devstack sudo[87093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae Apr 09 13:33:55 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:55 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_mvnr74g9 Apr 09 13:33:55 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:56 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-3849fbc4-7fef-4da0-9807-ed2b641b7367" returned: 0 in 0.536s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-3849fbc4-7fef-4da0-9807-ed2b641b7367" released by "delete_volume" :: held 1.141s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Created reservations ['f5e4a264-1f76-4a1e-9623-6aedaf30eb4e', '59590329-7b96-44ad-b729-148dd790e010', '2228422b-5f84-443f-8162-e8557e2d35ec', '1a20e497-41ba-4265-a1b1-2b6e7f3b8ee8'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:56 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:33:56 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:56 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae" returned: 0 in 0.510s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:56 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 1G Apr 09 13:33:56 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:56 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_mvnr74g9" returned: 0 in 0.598s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_mvnr74g9 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:56 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_mvnr74g9 Apr 09 13:33:56 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:56 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.486s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:33:56 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Deleted volume successfully. Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-de8c470a-9dd1-4c78-be8e-5a438c8ecbd1 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-3849fbc4-7fef-4da0-9807-ed2b641b7367-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:33:56 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 1G" returned: 0 in 0.512s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b7d09e-1398-4170-b052-39c1384574ae -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:56 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b7d09e-1398-4170-b052-39c1384574ae -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 Apr 09 13:33:56 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:56 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_mvnr74g9" returned: 1 in 0.527s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_mvnr74g9' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8043cdd-45f0-425e-b91b-8894b7ec70f4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:56 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD Apr 09 13:33:56 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:57 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b7d09e-1398-4170-b052-39c1384574ae -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107" returned: 0 in 0.542s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:57 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 is being set with open permissions: ugo+rw Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:57 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 Apr 09 13:33:57 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Flow 'volume_create_manager' (902a29ad-afc3-4871-b51a-fe6b5cad0354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4841e3-34c8-498c-966a-4013b89e3d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4841e3-34c8-498c-966a-4013b89e3d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-36898554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2db4d7a-0ffc-4a93-bce1-ce80021aa576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f060a2ed59d47179d6879bd63fc8eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:57Z,use_quota=True,user_id='c540142424de4076bdb8e9a21bacb62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:57 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f009256-c3a3-4240-b341-c2e686634db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f009256-c3a3-4240-b341-c2e686634db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73bb677-31bd-4177-bfc4-b9fdc66bcb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a73bb677-31bd-4177-bfc4-b9fdc66bcb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2db4d7a-0ffc-4a93-bce1-ce80021aa576', 'volume_name': 'volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee67fa5-3561-4524-8009-dacdd6c7459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee67fa5-3561-4524-8009-dacdd6c7459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24199c34-f71a-41fb-b606-7cd3dbf752ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:57 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Volume c2db4d7a-0ffc-4a93-bce1-ce80021aa576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576', 'volume_size': 1} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD" returned: 0 in 0.575s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e was qcow2, converting to raw {{(pid=82346) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:57 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 Apr 09 13:33:57 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:57 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107" returned: 0 in 0.449s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:57 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.info Apr 09 13:33:57 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:58 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.info" returned: 0 in 0.474s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:58 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.info is being set with open permissions: ugo+rw Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:58 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.info Apr 09 13:33:58 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:58 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63" returned: 0 in 0.960s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_3xpwv11ydevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:33:58 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Converted 112.00 MB image at 112.00 MB/s Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:58 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 1G Apr 09 13:33:58 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:58 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.info" returned: 0 in 0.439s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.990s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.236s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-36898554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2db4d7a-0ffc-4a93-bce1-ce80021aa576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f060a2ed59d47179d6879bd63fc8eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:33:57Z,use_quota=True,user_id='c540142424de4076bdb8e9a21bacb62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Creating volume c2db4d7a-0ffc-4a93-bce1-ce80021aa576 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:33:58 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:58 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 1073741824 Apr 09 13:33:58 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:58 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-f6042ee8-a1fd-445a-a931-be17859371de req-11cca4f2-81b6-49d9-aba3-3343247bc28a tempest-VolumesSnapshotsTestJSON-1853353540 None] Create snapshot completed successfully Apr 09 13:33:58 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 1G" returned: 0 in 0.478s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8ba40d-9b13-45e3-abf9-09c32b331df0]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:59 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 Apr 09 13:33:59 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Acquiring lock "cinder-1e5b9967-a4be-412c-80d7-07164496a107-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "cinder-1e5b9967-a4be-412c-80d7-07164496a107-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Acquiring lock "cinder-quobyte-33b7d09e-1398-4170-b052-39c1384574ae" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "cinder-quobyte-33b7d09e-1398-4170-b052-39c1384574ae" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Acquiring lock "cinder-quobyte-1e5b9967-a4be-412c-80d7-07164496a107" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "cinder-quobyte-1e5b9967-a4be-412c-80d7-07164496a107" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Deleting offline snapshot 1e5b9967-a4be-412c-80d7-07164496a107 of volume 33b7d09e-1398-4170-b052-39c1384574ae {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] snapshot_file for this snap is: volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8af8df-8526-4187-b1fb-47f854da0642]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:59 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 1073741824" returned: 0 in 0.551s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:59 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 Apr 09 13:33:59 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:59 devstack sudo[87164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 Apr 09 13:33:59 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:59 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63" returned: 0 in 0.504s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:59 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 Apr 09 13:33:59 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:33:59 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107" returned: 0 in 0.515s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b7d09e-1398-4170-b052-39c1384574ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:33:59 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" returned: 0 in 0.498s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[da584dd1-7fb9-4083-8e32-6a1564e7f150]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24199c34-f71a-41fb-b606-7cd3dbf752ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3847ec62-29b2-4c4a-b401-6681227ee25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:33:59 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Volume volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 (c2db4d7a-0ffc-4a93-bce1-ce80021aa576): created successfully Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3847ec62-29b2-4c4a-b401-6681227ee25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:33:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Flow 'volume_create_manager' (902a29ad-afc3-4871-b51a-fe6b5cad0354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:33:59 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-bbc491aa-8004-45c9-b041-a244fd1b49af tempest-VolumesSnapshotTestJSON-2134530092 None] Created volume successfully. Apr 09 13:33:59 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae Apr 09 13:33:59 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:00 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63" returned: 1 in 0.540s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Downloaded image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e ((None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}])) to volume 704061ae-1ddc-4c09-b8cd-db68d4a86f63 successfully. {{(pid=82346) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Temporary image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e for user 4d225eaaea8540f797eb4bfe4af9ab5c is deleted. {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Marking volume 704061ae-1ddc-4c09-b8cd-db68d4a86f63 as bootable. {{(pid=82346) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Copying metadata from image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e to 704061ae-1ddc-4c09-b8cd-db68d4a86f63. {{(pid=82346) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Creating volume glance metadata for volume 704061ae-1ddc-4c09-b8cd-db68d4a86f63 backed by image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82346) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3929bb-a272-462b-aeb6-803b99cbee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891a4e1d-209b-4078-90e0-278306a23f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:00 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Volume volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 (704061ae-1ddc-4c09-b8cd-db68d4a86f63): created successfully Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891a4e1d-209b-4078-90e0-278306a23f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Flow 'volume_create_manager' (25b4d2df-89b9-4eb4-ba2b-594d2133431e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:00 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-29dc70cf-e502-4940-9a42-9aeaa9417b3a tempest-VolumesExtendTest-1554802757 None] Created volume successfully. Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-84981df5-eade-435e-a8fe-5fac814ef6e5 tempest-VolumesExtendTest-1554802757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-84981df5-eade-435e-a8fe-5fac814ef6e5 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc4f397-b121-4a3f-84bc-d5f8ade92cd0]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-84981df5-eade-435e-a8fe-5fac814ef6e5 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:00 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae" returned: 0 in 0.638s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:00 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 Apr 09 13:34:00 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:00 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 Apr 09 13:34:00 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:01 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-84981df5-eade-435e-a8fe-5fac814ef6e5 tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63" returned: 0 in 0.628s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-84981df5-eade-435e-a8fe-5fac814ef6e5 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:01 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107" returned: 0 in 0.580s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:01 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107 Apr 09 13:34:01 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:01 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 Apr 09 13:34:01 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:01 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae.1e5b9967-a4be-412c-80d7-07164496a107" returned: 0 in 0.502s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:01 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-84981df5-eade-435e-a8fe-5fac814ef6e5 tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63" returned: 1 in 0.548s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-84981df5-eade-435e-a8fe-5fac814ef6e5 tempest-VolumesExtendTest-1554802757 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-84981df5-eade-435e-a8fe-5fac814ef6e5 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 2G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "cinder-quobyte-1e5b9967-a4be-412c-80d7-07164496a107" released by "_delete_snapshot" :: held 2.322s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "cinder-quobyte-33b7d09e-1398-4170-b052-39c1384574ae" released by "delete_snapshot" :: held 2.339s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-84981df5-eade-435e-a8fe-5fac814ef6e5 tempest-VolumesExtendTest-1554802757 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 2G" returned: 0 in 0.052s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-84981df5-eade-435e-a8fe-5fac814ef6e5 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.259s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.903s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] Creating offline snapshot 4daba7ce-89d1-4bd1-86f7-8a16c288f817 of volume c2db4d7a-0ffc-4a93-bce1-ce80021aa576 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG cinder.quota [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Created reservations ['e286e862-1a78-4d0e-acb7-7374be32e4e0', '45ce5578-9e0c-4729-b763-80f2aec90f2b', 'd0eca36c-cd8b-40cb-b362-667387f1d9dd', '61aedd16-dfe3-4a2d-8324-e0527346b555'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba50d56d-10b6-461d-8214-d51dda459a15]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:01 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-84981df5-eade-435e-a8fe-5fac814ef6e5 tempest-VolumesExtendTest-1554802757 None] Extend volume completed successfully. Apr 09 13:34:01 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Delete snapshot completed successfully. Apr 09 13:34:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-a4b84456-6dbd-4ff4-9a9d-465ac4ec096d req-82f46041-b192-4363-af5b-5cbb74763470 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "cinder-1e5b9967-a4be-412c-80d7-07164496a107-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:01 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 Apr 09 13:34:01 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:02 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" returned: 0 in 0.578s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:02 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 1G Apr 09 13:34:02 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Acquiring lock "cinder-33b7d09e-1398-4170-b052-39c1384574ae-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "cinder-33b7d09e-1398-4170-b052-39c1384574ae-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Acquiring lock "cinder-quobyte-33b7d09e-1398-4170-b052-39c1384574ae" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "cinder-quobyte-33b7d09e-1398-4170-b052-39c1384574ae" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e1b7dd-110c-4242-ac6c-0c0adf1ee785]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:02 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae Apr 09 13:34:02 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Acquiring lock "cinder-704061ae-1ddc-4c09-b8cd-db68d4a86f63-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Lock "cinder-704061ae-1ddc-4c09-b8cd-db68d4a86f63-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Acquiring lock "cinder-quobyte-704061ae-1ddc-4c09-b8cd-db68d4a86f63" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Lock "cinder-quobyte-704061ae-1ddc-4c09-b8cd-db68d4a86f63" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7210c5-6ccb-4cc8-a72d-913d5e4cb8cf]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:02 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 Apr 09 13:34:02 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:02 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 1G" returned: 0 in 0.670s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:02 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 Apr 09 13:34:02 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:03 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae" returned: 0 in 0.580s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:03 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae Apr 09 13:34:03 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:03 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63" returned: 0 in 0.586s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:03 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817" returned: 0 in 0.493s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:03 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 is being set with open permissions: ugo+rw Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:03 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 Apr 09 13:34:03 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:03 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 Apr 09 13:34:03 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:03 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-33b7d09e-1398-4170-b052-39c1384574ae" returned: 0 in 0.442s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "cinder-quobyte-33b7d09e-1398-4170-b052-39c1384574ae" released by "delete_volume" :: held 1.076s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG cinder.quota [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Created reservations ['2bcfa427-a848-4247-8761-377d05dcf298', '43927b42-ae93-42f7-a3dc-9244ca3c692c', '9f1f60ac-ef81-4712-b1e2-1e6114c47200', 'bb5ed30c-fd7c-45ed-b9a4-4d5084012627'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:03 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:03 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:03 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817" returned: 0 in 0.445s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:03 devstack sudo[87257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.info Apr 09 13:34:03 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:03 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63" returned: 1 in 0.558s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:34:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:03 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63 Apr 09 13:34:03 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:04 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.449s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG cinder.manager [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:04 devstack cinder-volume[82346]: INFO cinder.volume.manager [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Deleted volume successfully. Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [req-1aa3ae22-1a2c-4ad1-b67c-d4168caee9fc req-f938dbce-a1a5-4da7-b2da-e93941acb565 tempest-VolumesSnapshotsTestJSON-1853353540 None] Lock "cinder-33b7d09e-1398-4170-b052-39c1384574ae-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:04 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.info" returned: 0 in 0.457s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:04 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.info is being set with open permissions: ugo+rw Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:04 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.info Apr 09 13:34:04 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:04 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-704061ae-1ddc-4c09-b8cd-db68d4a86f63" returned: 0 in 0.436s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Lock "cinder-quobyte-704061ae-1ddc-4c09-b8cd-db68d4a86f63" released by "delete_volume" :: held 1.622s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Created reservations ['3ccf1549-9cfa-4ea4-926e-8c73e0137a32', '1ca461a2-129c-496d-b543-77e4290018df', 'ee381be6-d91a-4cee-af90-9c05944c4cb3', 'b7dba460-6593-41e4-a32e-f0f65f04a862'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:04 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:04 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:04 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.info" returned: 0 in 0.468s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.186s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:04 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-bc46550c-5499-4cdb-a186-9dca450163e6 tempest-VolumesSnapshotTestJSON-2134530092 None] Create snapshot completed successfully Apr 09 13:34:05 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.533s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:05 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Deleted volume successfully. Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e691cfe8-9afc-4669-85ee-cae48c5ce6c8 tempest-VolumesExtendTest-1554802757 None] Lock "cinder-704061ae-1ddc-4c09-b8cd-db68d4a86f63-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Flow 'volume_create_manager' (fd163fd7-f097-43a4-baf5-88b60ba85cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678ea3ab-9e03-4710-ae3f-82dd5bc1f5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678ea3ab-9e03-4710-ae3f-82dd5bc1f5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-621175493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d11ccd-8bb1-4cfd-86af-1ca28acbf960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd95eae6a8a4d5bad88bdb8f8c455e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:05Z,use_quota=True,user_id='4d225eaaea8540f797eb4bfe4af9ab5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7888b65f-bb1e-467c-92b9-981401d7ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7888b65f-bb1e-467c-92b9-981401d7ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14e0031-97c8-4c88-9e32-e5dadc9e7d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14e0031-97c8-4c88-9e32-e5dadc9e7d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2d11ccd-8bb1-4cfd-86af-1ca28acbf960', 'volume_name': 'volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd2e8d6-a146-46ff-842b-77389f39a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd2e8d6-a146-46ff-842b-77389f39a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9495ce64-0591-4530-90ea-b0a80810d54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:05 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Volume e2d11ccd-8bb1-4cfd-86af-1ca28acbf960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960', 'volume_size': 1} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-621175493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d11ccd-8bb1-4cfd-86af-1ca28acbf960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd95eae6a8a4d5bad88bdb8f8c455e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:05Z,use_quota=True,user_id='4d225eaaea8540f797eb4bfe4af9ab5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Creating volume e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:05 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:05 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 1073741824 Apr 09 13:34:05 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:05 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 1073741824" returned: 0 in 0.602s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:06 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 Apr 09 13:34:06 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Flow 'volume_create_manager' (ef037f97-a0cb-4815-bc86-497bd53b68d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7886a13e-79a3-43ce-8f41-08e3c848942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7886a13e-79a3-43ce-8f41-08e3c848942e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1247090234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8883604-e1d8-47dd-b714-d70d5defb322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f060a2ed59d47179d6879bd63fc8eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4daba7ce-89d1-4bd1-86f7-8a16c288f817,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:07Z,use_quota=True,user_id='c540142424de4076bdb8e9a21bacb62b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4eeb4ba-50ae-4eb2-a93a-842c57c8a73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4eeb4ba-50ae-4eb2-a93a-842c57c8a73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a5bd28-a1ac-464d-9139-5b387326e321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a5bd28-a1ac-464d-9139-5b387326e321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f8883604-e1d8-47dd-b714-d70d5defb322', 'volume_name': 'volume-f8883604-e1d8-47dd-b714-d70d5defb322', 'volume_size': 1, 'snapshot_id': '4daba7ce-89d1-4bd1-86f7-8a16c288f817'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb22221-a4e2-4d73-8aad-b913ca142e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb22221-a4e2-4d73-8aad-b913ca142e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c5d577-e8ce-45d6-81fc-2fcd5beed1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:06 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Volume f8883604-e1d8-47dd-b714-d70d5defb322: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f8883604-e1d8-47dd-b714-d70d5defb322', 'volume_size': 1, 'snapshot_id': '4daba7ce-89d1-4bd1-86f7-8a16c288f817'} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:06 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" returned: 0 in 0.943s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.246s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-4daba7ce-89d1-4bd1-86f7-8a16c288f817-f8883604-e1d8-47dd-b714-d70d5defb322" by "_create_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9495ce64-0591-4530-90ea-b0a80810d54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5babfe-9744-47db-9716-16afa30cd2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:06 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Volume volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 (e2d11ccd-8bb1-4cfd-86af-1ca28acbf960): created successfully Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5babfe-9744-47db-9716-16afa30cd2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Flow 'volume_create_manager' (fd163fd7-f097-43a4-baf5-88b60ba85cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-4daba7ce-89d1-4bd1-86f7-8a16c288f817-f8883604-e1d8-47dd-b714-d70d5defb322" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Creating volume f8883604-e1d8-47dd-b714-d70d5defb322 from snapshot 4daba7ce-89d1-4bd1-86f7-8a16c288f817 {{(pid=82346) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-f8883604-e1d8-47dd-b714-d70d5defb322" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:06 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-92974e50-5e38-499d-b3fe-23678df20416 tempest-VolumesExtendTest-1554802757 None] Created volume successfully. Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-f8883604-e1d8-47dd-b714-d70d5defb322" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] snapshot: 4daba7ce-89d1-4bd1-86f7-8a16c288f817, volume: f8883604-e1d8-47dd-b714-d70d5defb322, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ae7829-1eff-41a8-afda-b35e17bbd89f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:07 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 Apr 09 13:34:07 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:07 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817" returned: 0 in 0.687s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f7d428-63ff-4a92-a956-7a91ee659e53]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:07 devstack sudo[87315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 Apr 09 13:34:07 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:07 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-796a49ef-4e2c-4def-ae10-1d57ec5297c7 tempest-GroupSnapshotsTest-1499236982 None] Group tempest-GroupSnapshotsTest-Group-1466224341: creating Apr 09 13:34:08 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-796a49ef-4e2c-4def-ae10-1d57ec5297c7 tempest-GroupSnapshotsTest-1499236982 None] Group tempest-GroupSnapshotsTest-Group-1466224341: created successfully Apr 09 13:34:08 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-796a49ef-4e2c-4def-ae10-1d57ec5297c7 tempest-GroupSnapshotsTest-1499236982 None] Create group completed successfully. Apr 09 13:34:08 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" returned: 0 in 0.564s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:08 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:34:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:08 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322 Apr 09 13:34:08 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3e8ae3e3-0ece-4ad9-9821-5bf55c191a7e tempest-VolumesActionsTest-1792904640 None] Acquiring lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77" by "attach_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3e8ae3e3-0ece-4ad9-9821-5bf55c191a7e tempest-VolumesActionsTest-1792904640 None] Lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77" acquired by "attach_volume" :: waited 0.016s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:08 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3e8ae3e3-0ece-4ad9-9821-5bf55c191a7e tempest-VolumesActionsTest-1792904640 None] Attaching volume 4f917618-c0c2-4dd6-a653-7ef97e69eb77 to instance d7177bb8-2630-4613-bedb-8fe09fb2498b at mountpoint /dev/vdb on host None. Apr 09 13:34:08 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3e8ae3e3-0ece-4ad9-9821-5bf55c191a7e tempest-VolumesActionsTest-1792904640 None] Attach volume completed successfully. Apr 09 13:34:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3e8ae3e3-0ece-4ad9-9821-5bf55c191a7e tempest-VolumesActionsTest-1792904640 None] Lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77" released by "attach_volume" :: held 0.068s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-706e7a5b-f396-4606-9c9a-03d68d0f61bf tempest-VolumesActionsTest-1792904640 None] Acquiring lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77-detach_volume" by "detach_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-706e7a5b-f396-4606-9c9a-03d68d0f61bf tempest-VolumesActionsTest-1792904640 None] Lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:09 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-706e7a5b-f396-4606-9c9a-03d68d0f61bf tempest-VolumesActionsTest-1792904640 None] Detaching volume 4f917618-c0c2-4dd6-a653-7ef97e69eb77 from instance d7177bb8-2630-4613-bedb-8fe09fb2498b. Apr 09 13:34:09 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-706e7a5b-f396-4606-9c9a-03d68d0f61bf tempest-VolumesActionsTest-1792904640 None] Detach volume completed successfully. Apr 09 13:34:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-706e7a5b-f396-4606-9c9a-03d68d0f61bf tempest-VolumesActionsTest-1792904640 None] Lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Flow 'volume_create_manager' (b44bc072-5e81-4c75-8f55-18e2b290ce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4d263b-a7b3-41c9-9b83-d61ad8af8717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4d263b-a7b3-41c9-9b83-d61ad8af8717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1426398007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71a2741a-d718-49f2-bf5d-2df6542a3aab,host='devstack@QuobyteHD#QuobyteHD',id=da49b70b-d201-45b7-9dc9-d1c44e19dcca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4862ef611c4c3a9aac3bd9d1a5cd25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:11Z,use_quota=True,user_id='4732c034fda84b85b8b642d98670b1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da609eae-910b-4d02-87ad-33f300a6ea8d),volume_type_id=da609eae-910b-4d02-87ad-33f300a6ea8d)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b4aa62-7f26-42ed-92ae-8750c2eb57ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b4aa62-7f26-42ed-92ae-8750c2eb57ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2537aa-d035-4032-b4d6-56e1b15f9279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2537aa-d035-4032-b4d6-56e1b15f9279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da49b70b-d201-45b7-9dc9-d1c44e19dcca', 'volume_name': 'volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f6f35b-73ea-44c7-be95-0ee136e1fa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f6f35b-73ea-44c7-be95-0ee136e1fa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616d7b59-4017-4666-9082-772c4d7c9deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:10 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Volume da49b70b-d201-45b7-9dc9-d1c44e19dcca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca', 'volume_size': 1} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:10 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322" returned: 0 in 2.608s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2e257f-4153-4d0c-ae4a-79f1f1cc4915]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:11 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 Apr 09 13:34:11 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:11 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" returned: 0 in 0.615s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:11 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576, size 1024.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:34:11 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Converted 1024.00 MB image at 392.59 MB/s Apr 09 13:34:11 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322 is being set with open permissions: ugo+rw Apr 09 13:34:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:11 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322 Apr 09 13:34:11 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:11 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322" returned: 0 in 0.455s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-f8883604-e1d8-47dd-b714-d70d5defb322" released by "_copy_volume_from_snapshot" :: held 5.023s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-4daba7ce-89d1-4bd1-86f7-8a16c288f817-f8883604-e1d8-47dd-b714-d70d5defb322" released by "_create_volume_from_snapshot" :: held 5.065s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.114s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.417s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] Creating offline snapshot 8723a3cc-1905-4054-a204-516607e6b138 of volume e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[7170d83f-6daa-42eb-b76b-f466273afcb5]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c5d577-e8ce-45d6-81fc-2fcd5beed1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8883604-e1d8-47dd-b714-d70d5defb322', 'volume_size': 1, 'snapshot_id': '4daba7ce-89d1-4bd1-86f7-8a16c288f817'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e528b440-0b2d-4ef1-90e0-4cc07933bb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:12 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Volume volume-f8883604-e1d8-47dd-b714-d70d5defb322 (f8883604-e1d8-47dd-b714-d70d5defb322): created successfully Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e528b440-0b2d-4ef1-90e0-4cc07933bb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Flow 'volume_create_manager' (ef037f97-a0cb-4815-bc86-497bd53b68d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:12 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-0fb12311-6093-4bb5-ad9f-f568728cf6ab tempest-VolumesSnapshotTestJSON-2134530092 None] Created volume successfully. Apr 09 13:34:12 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 Apr 09 13:34:12 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-f8883604-e1d8-47dd-b714-d70d5defb322-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-f8883604-e1d8-47dd-b714-d70d5defb322-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-f8883604-e1d8-47dd-b714-d70d5defb322" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-f8883604-e1d8-47dd-b714-d70d5defb322" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0976ac0-ca3b-4eb5-9863-f24de8f6a333]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:12 devstack sudo[87371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322 Apr 09 13:34:12 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:12 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" returned: 0 in 0.567s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:12 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 1G Apr 09 13:34:12 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:12 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322" returned: 0 in 0.528s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:12 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322 Apr 09 13:34:12 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:13 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 1G" returned: 0 in 0.519s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:13 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 Apr 09 13:34:13 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:13 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f8883604-e1d8-47dd-b714-d70d5defb322" returned: 0 in 0.519s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-f8883604-e1d8-47dd-b714-d70d5defb322" released by "delete_volume" :: held 1.084s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Created reservations ['d5f240d1-a0a7-4f48-a390-d2632ff5cf8f', '6b75b6cc-ff93-4959-adf3-53e6716b413b', '164a94fb-5e48-4866-903b-01f037f7a1bd', '50c2e07b-1a6d-4582-a9d7-9378fe54d422'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:13 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:13 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:13 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138" returned: 0 in 0.528s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:13 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 is being set with open permissions: ugo+rw Apr 09 13:34:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:13 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 Apr 09 13:34:13 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:14 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.441s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:14 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Deleted volume successfully. Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a1f999df-eeae-41df-b6ac-f1838c21c739 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-f8883604-e1d8-47dd-b714-d70d5defb322-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:14 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138" returned: 0 in 0.438s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:14 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.info Apr 09 13:34:14 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-4daba7ce-89d1-4bd1-86f7-8a16c288f817-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:14 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-4daba7ce-89d1-4bd1-86f7-8a16c288f817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.info" returned: 0 in 0.454s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:14 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.info is being set with open permissions: ugo+rw Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:14 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.info Apr 09 13:34:14 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-4daba7ce-89d1-4bd1-86f7-8a16c288f817" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-4daba7ce-89d1-4bd1-86f7-8a16c288f817" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Deleting offline snapshot 4daba7ce-89d1-4bd1-86f7-8a16c288f817 of volume c2db4d7a-0ffc-4a93-bce1-ce80021aa576 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] snapshot_file for this snap is: volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[7441a1aa-4e8f-49ba-b7f8-5e9f5f7e6043]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:14 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 Apr 09 13:34:14 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:15 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.info" returned: 0 in 0.434s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.015s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.163s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=71a2741a-d718-49f2-bf5d-2df6542a3aab,created_at=2026-04-09T11:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1426398007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71a2741a-d718-49f2-bf5d-2df6542a3aab,host='devstack@QuobyteHD#QuobyteHD',id=da49b70b-d201-45b7-9dc9-d1c44e19dcca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4862ef611c4c3a9aac3bd9d1a5cd25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:11Z,use_quota=True,user_id='4732c034fda84b85b8b642d98670b1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da609eae-910b-4d02-87ad-33f300a6ea8d),volume_type_id=da609eae-910b-4d02-87ad-33f300a6ea8d)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Creating volume da49b70b-d201-45b7-9dc9-d1c44e19dcca {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:15 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:15 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca 1073741824 Apr 09 13:34:15 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-05238561-ba52-4df8-b4fa-990eceb15835 tempest-VolumesExtendTest-1554802757 None] Create snapshot completed successfully Apr 09 13:34:15 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:15 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817" returned: 0 in 0.524s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[54935141-f70a-43be-88e0-3ba04420c00d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:15 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 Apr 09 13:34:15 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-33e0f25b-4cc6-47a7-ac2f-151c3f21d5e3 tempest-VolumesExtendTest-1554802757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:15 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca 1073741824" returned: 0 in 0.565s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:15 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca Apr 09 13:34:15 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:15 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" returned: 0 in 0.574s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:15 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 Apr 09 13:34:15 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:16 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca" returned: 0 in 0.449s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-33e0f25b-4cc6-47a7-ac2f-151c3f21d5e3 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.750s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616d7b59-4017-4666-9082-772c4d7c9deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3d6a56-831c-47ad-87f4-25ef9037addc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8c5c34-4061-4279-b86d-e1ca63c2fe95]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-33e0f25b-4cc6-47a7-ac2f-151c3f21d5e3 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:16 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Volume volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca (da49b70b-d201-45b7-9dc9-d1c44e19dcca): created successfully Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3d6a56-831c-47ad-87f4-25ef9037addc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Flow 'volume_create_manager' (b44bc072-5e81-4c75-8f55-18e2b290ce24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:16 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e39099ba-5237-4b83-af9e-28b17ade7fe3 tempest-GroupSnapshotsTest-1499236982 None] Created volume successfully. Apr 09 13:34:16 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 Apr 09 13:34:16 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:16 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817" returned: 0 in 0.487s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:16 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817 Apr 09 13:34:16 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:16 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] GroupSnapshot 0e46aa43-d867-4b80-b7eb-ddbe09cb739f: creating. Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] Group snapshot 0e46aa43-d867-4b80-b7eb-ddbe09cb739f: creating. {{(pid=82346) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:16 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-33e0f25b-4cc6-47a7-ac2f-151c3f21d5e3 tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" returned: 0 in 0.546s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-33e0f25b-4cc6-47a7-ac2f-151c3f21d5e3 tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 2G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:16 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576.4daba7ce-89d1-4bd1-86f7-8a16c288f817" returned: 0 in 0.481s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-33e0f25b-4cc6-47a7-ac2f-151c3f21d5e3 tempest-VolumesExtendTest-1554802757 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 2G" returned: 0 in 0.096s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-33e0f25b-4cc6-47a7-ac2f-151c3f21d5e3 tempest-VolumesExtendTest-1554802757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.668s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.310s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-4daba7ce-89d1-4bd1-86f7-8a16c288f817" released by "_delete_snapshot" :: held 2.145s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] Creating offline snapshot 76d10311-cb34-4ae6-be97-dc46a7568362 of volume da49b70b-d201-45b7-9dc9-d1c44e19dcca {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" released by "delete_snapshot" :: held 2.187s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e39d67-7715-4778-b6c8-abb2ba59d619]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:16 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-33e0f25b-4cc6-47a7-ac2f-151c3f21d5e3 tempest-VolumesExtendTest-1554802757 None] Extend volume completed successfully. Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Created reservations ['364634a7-9ea0-433c-a274-25f2fc0fb880', 'a502f863-b973-467b-b769-7a271fc44eb9', '569f6500-4ce9-4bd4-adc3-a0c58f982e39', 'd875a47e-677b-42db-83bc-794758be0b2b'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:16 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca Apr 09 13:34:16 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:16 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Delete snapshot completed successfully. Apr 09 13:34:16 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ecfb94dd-a1da-4c0f-947d-7fe297edaaab tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-4daba7ce-89d1-4bd1-86f7-8a16c288f817-delete_snapshot" released by "delete_snapshot" :: held 2.339s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:17 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca" returned: 0 in 0.527s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:17 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 1G Apr 09 13:34:17 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Acquiring lock "cinder-8723a3cc-1905-4054-a204-516607e6b138-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Lock "cinder-8723a3cc-1905-4054-a204-516607e6b138-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Acquiring lock "cinder-quobyte-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Lock "cinder-quobyte-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Acquiring lock "cinder-quobyte-8723a3cc-1905-4054-a204-516607e6b138" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Lock "cinder-quobyte-8723a3cc-1905-4054-a204-516607e6b138" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Deleting offline snapshot 8723a3cc-1905-4054-a204-516607e6b138 of volume e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] snapshot_file for this snap is: volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e609fa67-28be-4ee2-b653-ac4facb33f60]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:17 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 Apr 09 13:34:17 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-c2db4d7a-0ffc-4a93-bce1-ce80021aa576-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-c2db4d7a-0ffc-4a93-bce1-ce80021aa576-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" acquired by "delete_volume" :: waited 0.020s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a1be8-a410-4f51-ae76-652db9efb3a4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:17 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 1G" returned: 0 in 0.576s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:17 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 Apr 09 13:34:17 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:17 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 Apr 09 13:34:17 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:18 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138" returned: 0 in 0.564s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffddf51-8c0b-4e22-b012-6cd4d667913f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:18 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 Apr 09 13:34:18 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:18 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362" returned: 0 in 0.456s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:18 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:18 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 Apr 09 13:34:18 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:18 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" returned: 0 in 0.542s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:18 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576 Apr 09 13:34:18 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:18 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" returned: 0 in 0.520s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:18 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 Apr 09 13:34:18 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:18 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362" returned: 0 in 0.476s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:18 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.info Apr 09 13:34:18 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:18 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" returned: 0 in 0.488s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-c2db4d7a-0ffc-4a93-bce1-ce80021aa576" released by "delete_volume" :: held 1.066s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:18 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Created reservations ['c91d4c20-c3a4-46c5-b39e-1e2779d88c06', 'de518e65-3737-4f48-adec-f0ca71053dea', '600b4bf5-954a-45b9-b2a3-acffcf316221', 'e4b59ceb-dc73-4e90-9985-1ac7deae3426'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:19 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:19 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:19 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.info" returned: 0 in 0.418s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:19 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:19 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138" returned: 0 in 0.517s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:19 devstack sudo[87491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.info Apr 09 13:34:19 devstack sudo[87491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:19 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138 Apr 09 13:34:19 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:19 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.446s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:19 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Deleted volume successfully. Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-aa979da7-5d15-4024-814f-06ffa3bbc5b2 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-c2db4d7a-0ffc-4a93-bce1-ce80021aa576-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:19 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960.8723a3cc-1905-4054-a204-516607e6b138" returned: 0 in 0.465s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:19 devstack sudo[87491]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.info" returned: 0 in 0.504s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Lock "cinder-quobyte-8723a3cc-1905-4054-a204-516607e6b138" released by "_delete_snapshot" :: held 2.140s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Lock "cinder-quobyte-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" released by "delete_snapshot" :: held 2.162s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:19 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-9a77945f-67a3-434d-a37a-bbf6d2bbebaf tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 0e46aa43-d867-4b80-b7eb-ddbe09cb739f: created successfully Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Created reservations ['fb706ad3-53c2-4b6d-b550-61658f217a31', '314d6e75-7747-4055-8015-728735b7e9ff', '7035b920-381b-406f-80db-eb2e258c54e3', '64ae7ae8-5bd5-408c-aa81-fa96a1e5876d'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:19 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Delete snapshot completed successfully. Apr 09 13:34:19 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f68ae01a-22a1-4ba1-b35c-7dd4372aa39d tempest-VolumesExtendTest-1554802757 None] Lock "cinder-8723a3cc-1905-4054-a204-516607e6b138-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-93429acd-afbf-4682-835a-3fd333653967-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-93429acd-afbf-4682-835a-3fd333653967-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "cinder-quobyte-93429acd-afbf-4682-835a-3fd333653967" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-93429acd-afbf-4682-835a-3fd333653967" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6ebd45-b8d4-48b2-a2e8-730c10c23581]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:20 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 Apr 09 13:34:20 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:20 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967" returned: 0 in 0.570s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:20 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967 Apr 09 13:34:20 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Acquiring lock "cinder-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Lock "cinder-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Acquiring lock "cinder-quobyte-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Lock "cinder-quobyte-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16a9503-b10a-48ab-9c88-41178b9f4ecb]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:21 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 Apr 09 13:34:21 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:21 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-93429acd-afbf-4682-835a-3fd333653967" returned: 0 in 0.415s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-quobyte-93429acd-afbf-4682-835a-3fd333653967" released by "delete_volume" :: held 1.039s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Created reservations ['39c4dbcd-0010-47b1-ad7f-afa75cf87aa2', '92b58a18-93e2-40a9-9a9a-46a8440f61e9', 'f5d525e4-01dc-4c71-84e8-e3d17b4617f4', '5ca03c35-1f5e-4a30-a633-08eebec8e7ea'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:21 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:21 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-76d10311-cb34-4ae6-be97-dc46a7568362-95a95130-6201-453d-95d6-da5c470d8323" by "_create_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:21 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-76d10311-cb34-4ae6-be97-dc46a7568362-95a95130-6201-453d-95d6-da5c470d8323" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Creating volume 95a95130-6201-453d-95d6-da5c470d8323 from snapshot 76d10311-cb34-4ae6-be97-dc46a7568362 {{(pid=82346) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-95a95130-6201-453d-95d6-da5c470d8323" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" returned: 0 in 0.613s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-95a95130-6201-453d-95d6-da5c470d8323" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] snapshot: 76d10311-cb34-4ae6-be97-dc46a7568362, volume: 95a95130-6201-453d-95d6-da5c470d8323, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:34:21 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960 Apr 09 13:34:21 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc416a2e-d56d-4d8c-bdec-40ee86b3a6df]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:21 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 Apr 09 13:34:21 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:21 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.563s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:21 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Deleted volume successfully. Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3dcfc212-ced8-42d3-913c-129dfcf44457 tempest-VolumesSnapshotTestJSON-2134530092 None] Lock "cinder-93429acd-afbf-4682-835a-3fd333653967-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:21 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" returned: 0 in 0.452s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Lock "cinder-quobyte-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960" released by "delete_volume" :: held 1.119s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Created reservations ['3af4adba-c3fb-4e33-ac60-5b7b7e4fafdc', '25fde547-e94f-4de8-ab85-c68c4bb38565', 'ad0284d3-8169-4bf1-a6ff-54ffa825bc26', 'a788340e-5bbe-4a2d-b8f7-b491fbf4ae56'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:22 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362" returned: 0 in 0.527s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:34:22 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:22 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5fa393-5ba6-4756-a53c-fd022e4112dc]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:22 devstack sudo[87524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca Apr 09 13:34:22 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:22 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca" returned: 0 in 0.602s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:22 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.669s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:22 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Deleted volume successfully. Apr 09 13:34:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d1fb297-50fb-420e-b944-521f87e2a54f tempest-VolumesExtendTest-1554802757 None] Lock "cinder-e2d11ccd-8bb1-4cfd-86af-1ca28acbf960-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:22 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323 Apr 09 13:34:22 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:25 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323" returned: 0 in 2.689s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:25 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2439b2-dfbd-4d41-bfeb-59a8984ca123]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:25 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca Apr 09 13:34:25 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:26 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca" returned: 0 in 0.836s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:26 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca, size 1024.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:34:26 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Converted 1024.00 MB image at 380.65 MB/s Apr 09 13:34:26 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:34:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:26 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323 Apr 09 13:34:26 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:26 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323" returned: 0 in 0.678s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-95a95130-6201-453d-95d6-da5c470d8323" released by "_copy_volume_from_snapshot" :: held 5.428s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-76d10311-cb34-4ae6-be97-dc46a7568362-95a95130-6201-453d-95d6-da5c470d8323" released by "_create_volume_from_snapshot" :: held 5.476s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.487s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:27 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-87137f94-11f6-499c-bea0-32792e03a3e5 tempest-GroupSnapshotsTest-1499236982 None] Create group from source-snapshot-0e46aa43-d867-4b80-b7eb-ddbe09cb739f completed successfully. Apr 09 13:34:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-95a95130-6201-453d-95d6-da5c470d8323" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-95a95130-6201-453d-95d6-da5c470d8323" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:27 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8680efe-274a-4612-87d4-228f7d1f47c4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:27 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323 Apr 09 13:34:27 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:28 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323" returned: 0 in 0.709s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:28 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323 Apr 09 13:34:28 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:UPDATE=171,cinder:SELECT=171,cinder:INSERT=53,cinder:DELETE=15 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=168,cinder:INSERT=50,cinder:UPDATE=205,cinder:DELETE=15 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Flow 'volume_create_manager' (07751cc6-a5f0-459c-937b-7a1ab2dc9e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9905e9-385d-42c2-9ba8-5c7243ae1905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9905e9-385d-42c2-9ba8-5c7243ae1905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2027162078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca13387-04ea-46b0-9aee-449cb0e1edfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36c9ed17d004f7dbddbbfbdd79748c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='1542cbfc45fe4d01a91d1f19a9ad33c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a12ca9d-3a12-4fc3-945e-0f0b1aaff302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a12ca9d-3a12-4fc3-945e-0f0b1aaff302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28262eee-b44e-494a-af7e-e8c0d3952595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28262eee-b44e-494a-af7e-e8c0d3952595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca13387-04ea-46b0-9aee-449cb0e1edfe', 'volume_name': 'volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01342b3e-487f-44d7-937e-a95c89a081a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01342b3e-487f-44d7-937e-a95c89a081a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c716013-8b49-413c-a66f-00c3e874dc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Volume 7ca13387-04ea-46b0-9aee-449cb0e1edfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe', 'volume_size': 1} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2027162078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca13387-04ea-46b0-9aee-449cb0e1edfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e36c9ed17d004f7dbddbbfbdd79748c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='1542cbfc45fe4d01a91d1f19a9ad33c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Creating volume 7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:28 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:34:28 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe 1073741824 Apr 09 13:34:28 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Flow 'volume_create_manager' (a9eb6016-6780-42bc-878c-775a25019cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1828682d-1a80-4441-bcf0-560702d2e3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1828682d-1a80-4441-bcf0-560702d2e3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748927947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5208748e-94a6-43b4-8df7-e2760a8dd454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab28713890f44c58e4d6d381b259d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='18fbfaade6e2456c85b6cdac2738ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a80f71-7cc7-4082-8409-4ca7c68c4813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a80f71-7cc7-4082-8409-4ca7c68c4813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3816fa73-3fcd-44e7-9b50-a6ace5012b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3816fa73-3fcd-44e7-9b50-a6ace5012b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5208748e-94a6-43b4-8df7-e2760a8dd454', 'volume_name': 'volume-5208748e-94a6-43b4-8df7-e2760a8dd454', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0453626-b6a6-4c21-8661-e2ea07d46715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0453626-b6a6-4c21-8661-e2ea07d46715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8976fafa-37dd-4657-a9fc-7875331bc8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Volume 5208748e-94a6-43b4-8df7-e2760a8dd454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5208748e-94a6-43b4-8df7-e2760a8dd454', 'volume_size': 1} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Flow 'volume_create_manager' (d4d68ac6-9bb2-4f01-ae2f-10c4528305ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6671c8-2b26-4856-b62a-89afe75c0344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6671c8-2b26-4856-b62a-89afe75c0344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489053544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e6ee17-defc-442b-9bd2-d975b4017004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab28713890f44c58e4d6d381b259d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='18fbfaade6e2456c85b6cdac2738ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239e7d4c-58ed-4163-885d-ba8d6c025d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239e7d4c-58ed-4163-885d-ba8d6c025d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56174e75-1db6-4d2e-9139-242539a6e7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56174e75-1db6-4d2e-9139-242539a6e7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e6ee17-defc-442b-9bd2-d975b4017004', 'volume_name': 'volume-44e6ee17-defc-442b-9bd2-d975b4017004', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3892140-116a-4ef6-9afc-e0c11145a04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3892140-116a-4ef6-9afc-e0c11145a04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:28 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119834fa-99de-4b19-86fc-e7dc26254177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:28 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Volume 44e6ee17-defc-442b-9bd2-d975b4017004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e6ee17-defc-442b-9bd2-d975b4017004', 'volume_size': 1} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95a95130-6201-453d-95d6-da5c470d8323" returned: 0 in 0.652s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-95a95130-6201-453d-95d6-da5c470d8323" released by "delete_volume" :: held 1.386s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['ca9de5ac-d019-4f91-a36c-708a96bf8507'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Flow 'volume_create_manager' (43cb9ce5-b5d9-4b1a-837a-617c0b37b6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf3317d-a4b2-4be1-a7a0-d0fcd831a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf3317d-a4b2-4be1-a7a0-d0fcd831a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-710741541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f915173-1482-46e0-9f29-9a5275a72090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab28713890f44c58e4d6d381b259d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='18fbfaade6e2456c85b6cdac2738ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f43ba52-79a5-419d-bb00-3abfc33e5226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f43ba52-79a5-419d-bb00-3abfc33e5226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027d9d3a-02bb-48d2-845c-f5f359e29fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027d9d3a-02bb-48d2-845c-f5f359e29fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f915173-1482-46e0-9f29-9a5275a72090', 'volume_name': 'volume-0f915173-1482-46e0-9f29-9a5275a72090', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db297ed-fb58-4c8a-84af-57f38c8a15fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db297ed-fb58-4c8a-84af-57f38c8a15fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5872406-c0f0-4504-b976-5ee3a67d93e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Volume 0f915173-1482-46e0-9f29-9a5275a72090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f915173-1482-46e0-9f29-9a5275a72090', 'volume_size': 1} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:29 devstack cinder-volume[82346]: WARNING cinder.quota [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-644482385 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-644482385, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:34:29 devstack cinder-volume[82346]: WARNING cinder.quota [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-644482385 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-644482385, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['289e34f7-f6a0-4a19-9848-7e1dee2f609a', '4752da74-0432-4d02-a16b-bbb94f77f1cb', '35a39d9d-fc17-455b-b04f-c648649577ef', 'bed9efd6-9127-4aa9-8fe9-4a915f7d454c'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:29 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:29 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Flow 'volume_create_manager' (0f294552-1fb0-44dc-b5d3-d21acad1ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72280691-79fa-4441-9361-75b6fba64239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72280691-79fa-4441-9361-75b6fba64239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-47365807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d73c6c-074c-4214-aa1e-b36b7b14a631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab28713890f44c58e4d6d381b259d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='18fbfaade6e2456c85b6cdac2738ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccb088d-ef51-4809-b4ba-7eb99475fe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccb088d-ef51-4809-b4ba-7eb99475fe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4670f2bf-a14d-49fd-876a-ddc0f1161bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4670f2bf-a14d-49fd-876a-ddc0f1161bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d73c6c-074c-4214-aa1e-b36b7b14a631', 'volume_name': 'volume-55d73c6c-074c-4214-aa1e-b36b7b14a631', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c21193-2887-448e-ba9d-fc5507c9953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c21193-2887-448e-ba9d-fc5507c9953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1fcac4-7708-4ffe-8e24-e2ea7ed68b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Volume 55d73c6c-074c-4214-aa1e-b36b7b14a631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d73c6c-074c-4214-aa1e-b36b7b14a631', 'volume_size': 1} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:29 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe 1073741824" returned: 0 in 0.656s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:29 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe Apr 09 13:34:29 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Flow 'volume_create_manager' (d8b401e1-5b68-4b34-b3b8-9f15a3dd8ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f310be-62a0-43e4-b0fc-1291eaa7faff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f310be-62a0-43e4-b0fc-1291eaa7faff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240772871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66eb1d01-0fe0-4637-8b2d-6f42ccb981f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab28713890f44c58e4d6d381b259d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='18fbfaade6e2456c85b6cdac2738ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bc4335-9a3d-4d82-9abc-48dfa0095e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bc4335-9a3d-4d82-9abc-48dfa0095e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a99ddd-6c88-4c3f-b510-9a6ff61885de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a99ddd-6c88-4c3f-b510-9a6ff61885de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66eb1d01-0fe0-4637-8b2d-6f42ccb981f2', 'volume_name': 'volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e307542-6cdb-46e4-8434-76fea4d17a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e307542-6cdb-46e4-8434-76fea4d17a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94270a99-29ff-45e4-806b-429d316c5ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Volume 66eb1d01-0fe0-4637-8b2d-6f42ccb981f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2', 'volume_size': 1} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:29 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.504s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:29 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-06dd0e16-140d-4c0b-bd4b-9e773299b1cb tempest-GroupSnapshotsTest-1499236982 None] Delete group completed successfully. Apr 09 13:34:29 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 0e46aa43-d867-4b80-b7eb-ddbe09cb739f: deleting Apr 09 13:34:29 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe" returned: 0 in 0.450s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.018s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-748927947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5208748e-94a6-43b4-8df7-e2760a8dd454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab28713890f44c58e4d6d381b259d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='18fbfaade6e2456c85b6cdac2738ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Creating volume 5208748e-94a6-43b4-8df7-e2760a8dd454 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:29 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 0e46aa43-d867-4b80-b7eb-ddbe09cb739f: deleting {{(pid=82346) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 13:34:29 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454 1073741824 Apr 09 13:34:29 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c716013-8b49-413c-a66f-00c3e874dc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea20534d-de61-41b4-a28b-5ad35b8285dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:29 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Volume volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe (7ca13387-04ea-46b0-9aee-449cb0e1edfe): created successfully Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea20534d-de61-41b4-a28b-5ad35b8285dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Flow 'volume_create_manager' (07751cc6-a5f0-459c-937b-7a1ab2dc9e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-da49b70b-d201-45b7-9dc9-d1c44e19dcca" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:30 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e85a5684-06db-4198-bd43-6c1a336c9544 tempest-VolumesSnapshotListTestJSON-2040846348 None] Created volume successfully. Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-da49b70b-d201-45b7-9dc9-d1c44e19dcca" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-76d10311-cb34-4ae6-be97-dc46a7568362" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-76d10311-cb34-4ae6-be97-dc46a7568362" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Deleting offline snapshot 76d10311-cb34-4ae6-be97-dc46a7568362 of volume da49b70b-d201-45b7-9dc9-d1c44e19dcca {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] snapshot_file for this snap is: volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8c9103-b2b9-4372-9c75-557445245bb3]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:30 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 Apr 09 13:34:30 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:30 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454 1073741824" returned: 0 in 0.848s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:30 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454 Apr 09 13:34:30 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:30 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362" returned: 0 in 0.817s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5e2b5d-0f2f-4514-95e1-e4df482159b8]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:30 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca Apr 09 13:34:30 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:31 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454" returned: 0 in 0.520s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.345s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489053544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e6ee17-defc-442b-9bd2-d975b4017004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab28713890f44c58e4d6d381b259d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='18fbfaade6e2456c85b6cdac2738ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Creating volume 44e6ee17-defc-442b-9bd2-d975b4017004 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:31 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8976fafa-37dd-4657-a9fc-7875331bc8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5208748e-94a6-43b4-8df7-e2760a8dd454', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:31 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004 1073741824 Apr 09 13:34:31 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fcd818-2bb8-4c03-a1f0-6e035212d2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:31 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Volume volume-5208748e-94a6-43b4-8df7-e2760a8dd454 (5208748e-94a6-43b4-8df7-e2760a8dd454): created successfully Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fcd818-2bb8-4c03-a1f0-6e035212d2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Flow 'volume_create_manager' (a9eb6016-6780-42bc-878c-775a25019cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:31 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-35784756-06aa-4dfd-a2fb-49dd910018ce tempest-CreateVolumesFromImageTest-649348843 None] Created volume successfully. Apr 09 13:34:31 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca" returned: 0 in 0.547s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:31 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 Apr 09 13:34:31 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:31 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004 1073741824" returned: 0 in 0.653s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:32 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362" returned: 0 in 0.599s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:32 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004 Apr 09 13:34:32 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:32 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362 Apr 09 13:34:32 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:32 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca.76d10311-cb34-4ae6-be97-dc46a7568362" returned: 0 in 0.469s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-76d10311-cb34-4ae6-be97-dc46a7568362" released by "_delete_snapshot" :: held 2.497s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:32 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-da49b70b-d201-45b7-9dc9-d1c44e19dcca" released by "delete_snapshot" :: held 2.512s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004" returned: 0 in 0.506s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.370s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-710741541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f915173-1482-46e0-9f29-9a5275a72090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab28713890f44c58e4d6d381b259d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='18fbfaade6e2456c85b6cdac2738ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Creating volume 0f915173-1482-46e0-9f29-9a5275a72090 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:32 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119834fa-99de-4b19-86fc-e7dc26254177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e6ee17-defc-442b-9bd2-d975b4017004', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47862220-c1f6-4c2e-a65f-ec63086516f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:32 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090 1073741824 Apr 09 13:34:32 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:32 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Volume volume-44e6ee17-defc-442b-9bd2-d975b4017004 (44e6ee17-defc-442b-9bd2-d975b4017004): created successfully Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47862220-c1f6-4c2e-a65f-ec63086516f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Flow 'volume_create_manager' (d4d68ac6-9bb2-4f01-ae2f-10c4528305ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:32 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-1fcd80a9-2437-4bb8-9198-9b03b862662a tempest-CreateVolumesFromImageTest-649348843 None] Created volume successfully. Apr 09 13:34:32 devstack cinder-volume[82346]: WARNING cinder.quota [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-644482385 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-644482385, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['3a6b6877-a7ce-4848-9a24-60cc5d0ce478', '8782e2b4-1e85-4abe-becc-716e4b8255ca', '412f5ebe-e3e3-48fd-83d0-8182f3892143', '0c10fd16-920f-4764-a853-7eb99f7054b6'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:32 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b7bb97cc-6d46-405d-b91a-2797057128c5 tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 0e46aa43-d867-4b80-b7eb-ddbe09cb739f: deleted successfully Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-847d475f-edb4-44fd-83c6-e176f7536630 tempest-VolumesActionsTest-1792904640 None] Acquiring lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77" by "attach_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-847d475f-edb4-44fd-83c6-e176f7536630 tempest-VolumesActionsTest-1792904640 None] Lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77" acquired by "attach_volume" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:33 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-847d475f-edb4-44fd-83c6-e176f7536630 tempest-VolumesActionsTest-1792904640 None] Attaching volume 4f917618-c0c2-4dd6-a653-7ef97e69eb77 to instance a1fef622-9deb-4395-a9f7-28f2e272c53b at mountpoint /dev/vdb on host None. Apr 09 13:34:33 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-847d475f-edb4-44fd-83c6-e176f7536630 tempest-VolumesActionsTest-1792904640 None] Attach volume completed successfully. Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-847d475f-edb4-44fd-83c6-e176f7536630 tempest-VolumesActionsTest-1792904640 None] Lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77" released by "attach_volume" :: held 0.066s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:33 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090 1073741824" returned: 0 in 0.650s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:33 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090 Apr 09 13:34:33 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-da49b70b-d201-45b7-9dc9-d1c44e19dcca" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-da49b70b-d201-45b7-9dc9-d1c44e19dcca" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_service.periodic_task [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82346) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b39624-4cf7-423b-99a0-54e1c744a50b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:33 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:33 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:33 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca Apr 09 13:34:33 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d78d03be-885d-4da2-8cc4-7384b8a9fe5e tempest-VolumesActionsTest-1792904640 None] Acquiring lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77-detach_volume" by "detach_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d78d03be-885d-4da2-8cc4-7384b8a9fe5e tempest-VolumesActionsTest-1792904640 None] Lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:33 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d78d03be-885d-4da2-8cc4-7384b8a9fe5e tempest-VolumesActionsTest-1792904640 None] Detaching volume 4f917618-c0c2-4dd6-a653-7ef97e69eb77 from instance a1fef622-9deb-4395-a9f7-28f2e272c53b. Apr 09 13:34:33 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d78d03be-885d-4da2-8cc4-7384b8a9fe5e tempest-VolumesActionsTest-1792904640 None] Detach volume completed successfully. Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d78d03be-885d-4da2-8cc4-7384b8a9fe5e tempest-VolumesActionsTest-1792904640 None] Lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:33 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090" returned: 0 in 0.631s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.449s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-47365807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d73c6c-074c-4214-aa1e-b36b7b14a631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab28713890f44c58e4d6d381b259d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='18fbfaade6e2456c85b6cdac2738ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Creating volume 55d73c6c-074c-4214-aa1e-b36b7b14a631 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:33 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5872406-c0f0-4504-b976-5ee3a67d93e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f915173-1482-46e0-9f29-9a5275a72090', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:33 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a455a77c-b0ef-47e1-8965-3d371d56ac81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.586s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:33 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631 1073741824 Apr 09 13:34:33 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:33 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Volume volume-0f915173-1482-46e0-9f29-9a5275a72090 (0f915173-1482-46e0-9f29-9a5275a72090): created successfully Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a455a77c-b0ef-47e1-8965-3d371d56ac81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Flow 'volume_create_manager' (43cb9ce5-b5d9-4b1a-837a-617c0b37b6fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:33 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca" returned: 0 in 0.606s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:33 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-1e4981ca-0b17-44cf-9dad-e4806c94f5df tempest-CreateVolumesFromImageTest-649348843 None] Created volume successfully. Apr 09 13:34:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:33 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca Apr 09 13:34:33 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:34 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-da49b70b-d201-45b7-9dc9-d1c44e19dcca" returned: 0 in 0.560s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-da49b70b-d201-45b7-9dc9-d1c44e19dcca" released by "delete_volume" :: held 1.214s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:34 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631 1073741824" returned: 0 in 0.688s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:34 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631 Apr 09 13:34:34 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['7b1b5304-3a85-4a6f-8322-6ca6d3964617'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:34 devstack cinder-volume[82346]: WARNING cinder.db.sqlalchemy.api [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-644482385'] Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['2dd6c827-aa5b-4d03-805b-01a319b6ab04', '4ae2bbc8-90fd-442c-a966-7e672634845a', '261a4e66-0000-4767-b832-fc45aa295fe6', '86bb3218-7468-4eaa-ba56-4fd82676ff24'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:34 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:34 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:34 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631" returned: 0 in 0.430s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:34:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.398s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-240772871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66eb1d01-0fe0-4637-8b2d-6f42ccb981f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ab28713890f44c58e4d6d381b259d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:29Z,use_quota=True,user_id='18fbfaade6e2456c85b6cdac2738ce1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Creating volume 66eb1d01-0fe0-4637-8b2d-6f42ccb981f2 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:35 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1fcac4-7708-4ffe-8e24-e2ea7ed68b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d73c6c-074c-4214-aa1e-b36b7b14a631', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:35 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2 1073741824 Apr 09 13:34:35 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc51748-8a0b-4a12-a66f-fb84c5fb90ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:35 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Volume volume-55d73c6c-074c-4214-aa1e-b36b7b14a631 (55d73c6c-074c-4214-aa1e-b36b7b14a631): created successfully Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc51748-8a0b-4a12-a66f-fb84c5fb90ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Flow 'volume_create_manager' (0f294552-1fb0-44dc-b5d3-d21acad1ded1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-64b21629-f019-4e5b-a68a-f72a00d0b2ce tempest-CreateVolumesFromImageTest-649348843 None] Created volume successfully. Apr 09 13:34:35 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.436s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-39a1d3c7-0f9c-4d85-9aa1-bab2c54a2b82 tempest-GroupSnapshotsTest-1499236982 None] Delete group completed successfully. Apr 09 13:34:35 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2 1073741824" returned: 0 in 0.707s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:35 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2 Apr 09 13:34:35 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-376a08e0-43d8-4066-abaa-1142ebb6221a tempest-GroupSnapshotsTest-1499236982 None] Group tempest-GroupSnapshotsTest-Group-1321041999: creating Apr 09 13:34:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-376a08e0-43d8-4066-abaa-1142ebb6221a tempest-GroupSnapshotsTest-1499236982 None] Group tempest-GroupSnapshotsTest-Group-1321041999: created successfully Apr 09 13:34:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-376a08e0-43d8-4066-abaa-1142ebb6221a tempest-GroupSnapshotsTest-1499236982 None] Create group completed successfully. Apr 09 13:34:36 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2" returned: 0 in 0.501s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.287s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Creating offline snapshot b8110c86-ea26-479f-aa78-ed8201fe5030 of volume 7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94270a99-29ff-45e4-806b-429d316c5ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f77c9e-9ff6-4793-a8cc-c9824f0feb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[67682783-26ed-4f65-8297-3c0287266365]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:36 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Volume volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2 (66eb1d01-0fe0-4637-8b2d-6f42ccb981f2): created successfully Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f77c9e-9ff6-4793-a8cc-c9824f0feb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Flow 'volume_create_manager' (d8b401e1-5b68-4b34-b3b8-9f15a3dd8ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:36 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f98f7aa7-6bcc-4b60-94ef-a2eaffc88775 tempest-CreateVolumesFromImageTest-649348843 None] Created volume successfully. Apr 09 13:34:36 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe Apr 09 13:34:36 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:36 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe" returned: 0 in 0.505s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:36 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 1G Apr 09 13:34:36 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Flow 'volume_create_manager' (c0470b43-a73e-405c-ad12-bf5fa1a9c10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8412dc62-0e32-4fb5-a883-d9136458ffe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8412dc62-0e32-4fb5-a883-d9136458ffe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160198614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17685549-5a48-4ee9-bae1-6c5383630c67,host='devstack@QuobyteHD#QuobyteHD',id=2ce35b1c-104e-4843-b363-276e943bd26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4862ef611c4c3a9aac3bd9d1a5cd25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:37Z,use_quota=True,user_id='4732c034fda84b85b8b642d98670b1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39ae26f6-537b-41e8-accc-78d8a685a244),volume_type_id=39ae26f6-537b-41e8-accc-78d8a685a244)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48707780-b80b-4788-8a3f-fe6d07d93492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48707780-b80b-4788-8a3f-fe6d07d93492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3511a2df-d4f6-4854-bf7c-fb595e35a0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3511a2df-d4f6-4854-bf7c-fb595e35a0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ce35b1c-104e-4843-b363-276e943bd26d', 'volume_name': 'volume-2ce35b1c-104e-4843-b363-276e943bd26d', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679fa67a-76f9-4431-800f-337f75b990ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679fa67a-76f9-4431-800f-337f75b990ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c791190c-bbb1-44e9-8e2b-5fb593641319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:37 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Volume 2ce35b1c-104e-4843-b363-276e943bd26d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ce35b1c-104e-4843-b363-276e943bd26d', 'volume_size': 1} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "cinder-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:37 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "cinder-quobyte-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 1G" returned: 0 in 0.597s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-quobyte-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2" acquired by "delete_volume" :: waited 0.021s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:37 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 Apr 09 13:34:37 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[12058c7f-39dd-460c-b8b6-06b31a072c30]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:37 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2 Apr 09 13:34:37 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:37 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030" returned: 0 in 0.458s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:37 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 is being set with open permissions: ugo+rw Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:37 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 Apr 09 13:34:37 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:37 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2" returned: 0 in 0.493s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:37 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2 Apr 09 13:34:37 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:38 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030" returned: 0 in 0.471s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:38 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2" returned: 0 in 0.441s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:38 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.info Apr 09 13:34:38 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-quobyte-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2" released by "delete_volume" :: held 0.960s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Created reservations ['73d0e539-cb15-4189-9d85-8538df594160', 'eca04449-687b-4a96-89d0-3603fcfd4aef', 'c67e514b-fd93-4c84-9f28-3d70839bf739', 'f100d7eb-b00e-4fc9-bfef-b1d22816e5df'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:38 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:38 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:38 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.info" returned: 0 in 0.416s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:38 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.info is being set with open permissions: ugo+rw Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:38 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.info Apr 09 13:34:38 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:38 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.492s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:38 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Deleted volume successfully. Apr 09 13:34:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82f33e4a-2242-42c8-a6f9-1935197e98d6 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-66eb1d01-0fe0-4637-8b2d-6f42ccb981f2-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:39 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.info" returned: 0 in 0.453s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.974s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.881s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17685549-5a48-4ee9-bae1-6c5383630c67,created_at=2026-04-09T11:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160198614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17685549-5a48-4ee9-bae1-6c5383630c67,host='devstack@QuobyteHD#QuobyteHD',id=2ce35b1c-104e-4843-b363-276e943bd26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4862ef611c4c3a9aac3bd9d1a5cd25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:37Z,use_quota=True,user_id='4732c034fda84b85b8b642d98670b1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39ae26f6-537b-41e8-accc-78d8a685a244),volume_type_id=39ae26f6-537b-41e8-accc-78d8a685a244)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Creating volume 2ce35b1c-104e-4843-b363-276e943bd26d {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:39 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:39 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d 1073741824 Apr 09 13:34:39 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:39 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b775152e-4ed0-46b2-afa1-c43b118fd9a5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Create snapshot completed successfully Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "cinder-55d73c6c-074c-4214-aa1e-b36b7b14a631-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-55d73c6c-074c-4214-aa1e-b36b7b14a631-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "cinder-quobyte-55d73c6c-074c-4214-aa1e-b36b7b14a631" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-quobyte-55d73c6c-074c-4214-aa1e-b36b7b14a631" acquired by "delete_volume" :: waited 0.019s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c2215a-9cc4-43b5-9a98-bb55df8c7991]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:39 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631 Apr 09 13:34:39 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:39 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d 1073741824" returned: 0 in 0.542s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:39 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d Apr 09 13:34:39 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:40 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631" returned: 0 in 0.506s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:40 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631 Apr 09 13:34:40 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:40 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d" returned: 0 in 0.450s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c791190c-bbb1-44e9-8e2b-5fb593641319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ce35b1c-104e-4843-b363-276e943bd26d', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b7cbd2-5b7c-4b8f-92f8-c871f6fc6f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:40 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Volume volume-2ce35b1c-104e-4843-b363-276e943bd26d (2ce35b1c-104e-4843-b363-276e943bd26d): created successfully Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b7cbd2-5b7c-4b8f-92f8-c871f6fc6f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Flow 'volume_create_manager' (c0470b43-a73e-405c-ad12-bf5fa1a9c10d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:40 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-8176b737-31c0-4f2d-9ad6-9fae1e235fe6 tempest-GroupSnapshotsTest-1499236982 None] Created volume successfully. Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] Creating offline snapshot eeb5905f-67f1-4bdd-bb10-057f5f081a61 of volume 7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ba3159-fb91-4e04-ba0a-53e44510d962]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:40 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 Apr 09 13:34:40 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:40 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-55d73c6c-074c-4214-aa1e-b36b7b14a631" returned: 0 in 0.579s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-quobyte-55d73c6c-074c-4214-aa1e-b36b7b14a631" released by "delete_volume" :: held 1.115s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Created reservations ['f976f33e-8e9f-456d-a716-6ad3d1a7bfe3', 'b39833f7-7579-4d10-8fd9-c29c6d7ca6c9', '68c428de-67ed-4734-a1f8-0253a729865b', 'b6983c2a-23b4-4a8e-9279-239aa5755cc9'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:40 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:40 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Flow 'volume_create_manager' (b1745aba-1548-4b50-b8f9-1efe2568f366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774196c8-c9fb-4e91-8680-064789dc2036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774196c8-c9fb-4e91-8680-064789dc2036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596290090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17685549-5a48-4ee9-bae1-6c5383630c67,host='devstack@QuobyteHD#QuobyteHD',id=10996e63-1b30-4121-b711-dae80e90a826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4862ef611c4c3a9aac3bd9d1a5cd25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:41Z,use_quota=True,user_id='4732c034fda84b85b8b642d98670b1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39ae26f6-537b-41e8-accc-78d8a685a244),volume_type_id=39ae26f6-537b-41e8-accc-78d8a685a244)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2df1ae7-a607-4967-ae23-9b90fad32937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2df1ae7-a607-4967-ae23-9b90fad32937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928a1847-0374-469e-99ac-2077433ede0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928a1847-0374-469e-99ac-2077433ede0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10996e63-1b30-4121-b711-dae80e90a826', 'volume_name': 'volume-10996e63-1b30-4121-b711-dae80e90a826', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bac04e-8125-4f62-b07e-94c5fcdc2d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bac04e-8125-4f62-b07e-94c5fcdc2d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65289bcd-5da6-4973-aa7e-798532d00a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:40 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Volume 10996e63-1b30-4121-b711-dae80e90a826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10996e63-1b30-4121-b711-dae80e90a826', 'volume_size': 1} Apr 09 13:34:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:41 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030" returned: 0 in 0.684s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:41 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 1G Apr 09 13:34:41 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:41 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.547s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:41 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Deleted volume successfully. Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-924d0c59-ae1e-44ec-be14-911a0f221c55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-55d73c6c-074c-4214-aa1e-b36b7b14a631-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "cinder-0f915173-1482-46e0-9f29-9a5275a72090-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-0f915173-1482-46e0-9f29-9a5275a72090-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "cinder-quobyte-0f915173-1482-46e0-9f29-9a5275a72090" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-quobyte-0f915173-1482-46e0-9f29-9a5275a72090" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[762f3899-50b4-4992-8e09-92cf944fa2f0]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:41 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 1G" returned: 0 in 0.621s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:41 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 Apr 09 13:34:41 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:41 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090 Apr 09 13:34:41 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:42 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61" returned: 0 in 0.460s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:42 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 is being set with open permissions: ugo+rw Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:42 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 Apr 09 13:34:42 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:42 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090" returned: 0 in 0.534s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:42 devstack sudo[87799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090 Apr 09 13:34:42 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:42 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61" returned: 0 in 0.424s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.807s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17685549-5a48-4ee9-bae1-6c5383630c67,created_at=2026-04-09T11:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1596290090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17685549-5a48-4ee9-bae1-6c5383630c67,host='devstack@QuobyteHD#QuobyteHD',id=10996e63-1b30-4121-b711-dae80e90a826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4862ef611c4c3a9aac3bd9d1a5cd25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:34:41Z,use_quota=True,user_id='4732c034fda84b85b8b642d98670b1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39ae26f6-537b-41e8-accc-78d8a685a244),volume_type_id=39ae26f6-537b-41e8-accc-78d8a685a244)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Creating volume 10996e63-1b30-4121-b711-dae80e90a826 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:34:42 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:42 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 1073741824 Apr 09 13:34:42 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:42 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-090899fb-9891-482b-87db-5fb15a0b1839 tempest-VolumesSnapshotListTestJSON-2040846348 None] Create snapshot completed successfully Apr 09 13:34:42 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-0f915173-1482-46e0-9f29-9a5275a72090" returned: 0 in 0.488s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-quobyte-0f915173-1482-46e0-9f29-9a5275a72090" released by "delete_volume" :: held 1.058s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Created reservations ['5134d080-bd9e-4cb6-8c3a-fdab0768fe4c', '9374db45-5f59-4231-b6a0-72efa039d856', '608d03b1-1b98-465d-ba07-7f3299a375f7', '292f39e6-d0dd-4c64-93e5-7584c9151d1f'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:42 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:42 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:43 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 1073741824" returned: 0 in 0.534s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:43 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 Apr 09 13:34:43 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:43 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.481s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:43 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Deleted volume successfully. Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6270322b-0d8b-48c5-ac68-8e57ae934a55 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-0f915173-1482-46e0-9f29-9a5275a72090-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:43 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826" returned: 0 in 0.488s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.916s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccb5b4a-c8ac-4b91-966d-82581b83fee5]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:43 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 Apr 09 13:34:43 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65289bcd-5da6-4973-aa7e-798532d00a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10996e63-1b30-4121-b711-dae80e90a826', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3ba459-0ff1-45d8-b1a9-6f85993ac5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:34:43 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Volume volume-10996e63-1b30-4121-b711-dae80e90a826 (10996e63-1b30-4121-b711-dae80e90a826): created successfully Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3ba459-0ff1-45d8-b1a9-6f85993ac5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Flow 'volume_create_manager' (b1745aba-1548-4b50-b8f9-1efe2568f366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:34:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:44 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-66d7e7c0-965d-4b74-a398-54cb9dda86d4 tempest-GroupSnapshotsTest-1499236982 None] Created volume successfully. Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "cinder-44e6ee17-defc-442b-9bd2-d975b4017004-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-44e6ee17-defc-442b-9bd2-d975b4017004-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "cinder-quobyte-44e6ee17-defc-442b-9bd2-d975b4017004" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-quobyte-44e6ee17-defc-442b-9bd2-d975b4017004" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f9a332-1e6d-4c17-9011-6857550f4ba1]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:44 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004 Apr 09 13:34:44 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:44 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-c7cde261-04fd-4a5e-b380-25757aca9252 tempest-GroupSnapshotsTest-1499236982 None] Update group completed successfully. Apr 09 13:34:44 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77" returned: 0 in 0.540s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9818d4c4-c319-4524-8783-158cd9452b24]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:44 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 Apr 09 13:34:44 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:44 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004" returned: 0 in 0.529s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:44 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004 Apr 09 13:34:44 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:44 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77" returned: 0 in 0.507s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.4208ac7d-b71f-44c4-a10c-3399144d735fftg34ak1.img {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:44 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.4208ac7d-b71f-44c4-a10c-3399144d735fftg34ak1.img Apr 09 13:34:44 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:45 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-44e6ee17-defc-442b-9bd2-d975b4017004" returned: 0 in 0.408s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-quobyte-44e6ee17-defc-442b-9bd2-d975b4017004" released by "delete_volume" :: held 0.978s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Created reservations ['7cb93232-6070-457d-bf4c-b05ca8d2e7ac', '0ec63359-e17b-44af-8b18-e1082ac51ddf', 'afeccc52-f682-42d4-9ba3-c245c1be19a5', '65d6286c-0cc6-49f3-9da2-cc773805b5c2'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:45 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:45 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "cinder-5208748e-94a6-43b4-8df7-e2760a8dd454-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-5208748e-94a6-43b4-8df7-e2760a8dd454-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "cinder-quobyte-5208748e-94a6-43b4-8df7-e2760a8dd454" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-quobyte-5208748e-94a6-43b4-8df7-e2760a8dd454" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d87a9b-2c94-4128-9a44-00efcb8f2183]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:45 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6ac4fda0-c304-4701-a3c8-2ddcfdc496bc tempest-GroupSnapshotsTest-1499236982 None] Update group completed successfully. Apr 09 13:34:45 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454 Apr 09 13:34:45 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:46 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454" returned: 0 in 1.142s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:46 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454 Apr 09 13:34:46 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:46 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 1.660s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:46 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:46 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Deleted volume successfully. Apr 09 13:34:46 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-83cb73fa-72b8-42c2-9fe9-be744a659bb5 tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-44e6ee17-defc-442b-9bd2-d975b4017004-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:46 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ef3ca8fa-cfa5-4e69-8bf7-1882c95b3daf tempest-GroupSnapshotsTest-1499236982 None] Update group completed successfully. Apr 09 13:34:47 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.4208ac7d-b71f-44c4-a10c-3399144d735fftg34ak1.img" returned: 0 in 2.241s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f2e919-0e2e-407a-be50-58bd28418e60]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:47 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 Apr 09 13:34:47 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:47 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5208748e-94a6-43b4-8df7-e2760a8dd454" returned: 0 in 0.871s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-quobyte-5208748e-94a6-43b4-8df7-e2760a8dd454" released by "delete_volume" :: held 2.036s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Created reservations ['b8c720bf-436e-49fb-b732-0ef192f1150b', '58e274dd-5468-4166-b8a0-50e7c3976053', '76a82d87-be36-4134-8ecd-e721aa8a882a', '38504733-634e-427f-a47b-94e2d210607e'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:47 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:34:47 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:47 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77" returned: 0 in 0.658s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.4208ac7d-b71f-44c4-a10c-3399144d735fftg34ak1.img {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:34:47 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] Converted 1024.00 MB image at 456.86 MB/s Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] 4208ac7d-b71f-44c4-a10c-3399144d735f was raw, no need to convert to raw {{(pid=82346) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 09 13:34:47 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.459s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:34:47 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Deleted volume successfully. Apr 09 13:34:47 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4b66e43a-cac7-443f-ad08-3c675436ecba tempest-CreateVolumesFromImageTest-649348843 None] Lock "cinder-5208748e-94a6-43b4-8df7-e2760a8dd454-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:34:48 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3ee24985-18fa-4361-950b-869056fbff8d tempest-GroupSnapshotsTest-1499236982 None] Update group completed successfully. Apr 09 13:34:49 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] GroupSnapshot 9d3b5f2a-1fa8-4f8c-84a5-96f9d7d87ee2: creating. Apr 09 13:34:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Group snapshot 9d3b5f2a-1fa8-4f8c-84a5-96f9d7d87ee2: creating. {{(pid=82346) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 13:34:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.152s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] Uploaded volume to glance image-id: 4208ac7d-b71f-44c4-a10c-3399144d735f. {{(pid=82346) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 09 13:34:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.944s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Creating offline snapshot f26637dd-4171-417d-82b8-330b6c6405d5 of volume 7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:34:57 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-82f00249-b0e7-41e6-a39d-d2aa7ec53a76 tempest-VolumesActionsTest-1792904640 None] Copy volume to image completed successfully. Apr 09 13:34:57 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bc7879-18fa-4960-ab95-948bb7513dad]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:58 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 Apr 09 13:34:58 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:58 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61" returned: 0 in 0.517s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:34:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:58 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 1G Apr 09 13:34:58 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:34:59 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 1G" returned: 0 in 0.519s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:59 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 Apr 09 13:34:59 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:59 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5" returned: 0 in 0.406s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:59 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 is being set with open permissions: ugo+rw Apr 09 13:34:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:59 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 Apr 09 13:34:59 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:34:59 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 09 13:34:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5" returned: 0 in 0.394s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:34:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:34:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.394s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:34:59 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Creating offline snapshot 7067901b-5730-4535-9c36-e217b43e2047 of volume 2ce35b1c-104e-4843-b363-276e943bd26d {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:34:59 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-83920aae-a32c-43ba-9b39-ac7e8ede35d2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Create snapshot completed successfully Apr 09 13:34:59 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9de8981-5e0b-404f-94a9-66b63a62ba06]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:34:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:34:59 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d Apr 09 13:34:59 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:00 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d" returned: 0 in 0.462s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:00 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 1G Apr 09 13:35:00 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:00 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 1G" returned: 0 in 0.505s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce35b1c-104e-4843-b363-276e943bd26d -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:00 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce35b1c-104e-4843-b363-276e943bd26d -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 Apr 09 13:35:00 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "cinder-f26637dd-4171-417d-82b8-330b6c6405d5-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-f26637dd-4171-417d-82b8-330b6c6405d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "cinder-quobyte-f26637dd-4171-417d-82b8-330b6c6405d5" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-f26637dd-4171-417d-82b8-330b6c6405d5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Deleting offline snapshot f26637dd-4171-417d-82b8-330b6c6405d5 of volume 7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] snapshot_file for this snap is: volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd49d7b-e79b-48ea-b5b5-f0b106dd2fe0]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:01 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 Apr 09 13:35:01 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:01 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ce35b1c-104e-4843-b363-276e943bd26d -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047" returned: 0 in 0.469s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:01 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:01 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 Apr 09 13:35:01 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:01 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5" returned: 0 in 0.474s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b780d9-5ae2-4aee-8f94-54139f5c4130]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:01 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 Apr 09 13:35:01 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:01 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047" returned: 0 in 0.420s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:01 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.info Apr 09 13:35:01 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:01 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61" returned: 0 in 0.474s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:02 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 Apr 09 13:35:02 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:02 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.info" returned: 0 in 0.414s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:02 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:35:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:02 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.info Apr 09 13:35:02 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:02 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5" returned: 0 in 0.583s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:02 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.info" returned: 0 in 0.416s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.752s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:02 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5 Apr 09 13:35:02 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Creating offline snapshot 922bd4f1-3ae8-4645-b474-bb12a86354af of volume 10996e63-1b30-4121-b711-dae80e90a826 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:35:02 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a76dd0-73ee-4a47-a618-9570245a46eb]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:02 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 Apr 09 13:35:02 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:03 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.f26637dd-4171-417d-82b8-330b6c6405d5" returned: 0 in 0.443s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-f26637dd-4171-417d-82b8-330b6c6405d5" released by "_delete_snapshot" :: held 2.032s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" released by "delete_snapshot" :: held 2.044s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:03 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Created reservations ['6d56022e-ba02-4ef0-952f-682d843b38e6', '840c04a7-e735-4dee-941b-1d63ea8c1f49', '0e457ebb-4668-4d5b-9315-ca8b2626c2f9', 'db42d05a-2f82-4f29-b579-abda34bd76bb'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:03 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826" returned: 0 in 0.515s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:03 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af 1G Apr 09 13:35:03 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:03 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Delete snapshot completed successfully. Apr 09 13:35:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-98680df8-98ad-4617-85e3-a622867f4fa4 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-f26637dd-4171-417d-82b8-330b6c6405d5-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:03 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af 1G" returned: 0 in 0.520s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10996e63-1b30-4121-b711-dae80e90a826 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:03 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10996e63-1b30-4121-b711-dae80e90a826 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af Apr 09 13:35:03 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "cinder-eeb5905f-67f1-4bdd-bb10-057f5f081a61-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-eeb5905f-67f1-4bdd-bb10-057f5f081a61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "cinder-quobyte-eeb5905f-67f1-4bdd-bb10-057f5f081a61" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-eeb5905f-67f1-4bdd-bb10-057f5f081a61" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:04 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Deleting offline snapshot eeb5905f-67f1-4bdd-bb10-057f5f081a61 of volume 7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] snapshot_file for this snap is: volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10996e63-1b30-4121-b711-dae80e90a826 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af" returned: 0 in 0.501s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:04 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a067fd-3671-4615-ba9f-f24056d2c2a6]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:04 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af Apr 09 13:35:04 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:04 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 Apr 09 13:35:04 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:04 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af" returned: 0 in 0.399s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:04 devstack sudo[87998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.info Apr 09 13:35:04 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:04 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61" returned: 0 in 0.522s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[384fc154-6055-45f6-ab5c-480adb6468b8]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:04 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 Apr 09 13:35:04 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:05 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.info" returned: 0 in 0.450s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:05 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:05 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.info Apr 09 13:35:05 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:05 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030" returned: 0 in 0.500s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:05 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 Apr 09 13:35:05 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:05 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.info" returned: 0 in 0.431s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.871s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.626s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7f094f-3abf-4bd7-b489-89ba9e9b1f17]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:05 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 Apr 09 13:35:05 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:05 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-1efced79-414d-4e91-926b-ed2503cdadb0 tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 9d3b5f2a-1fa8-4f8c-84a5-96f9d7d87ee2: created successfully Apr 09 13:35:05 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61" returned: 0 in 0.513s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:05 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61 Apr 09 13:35:05 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:06 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 9d3b5f2a-1fa8-4f8c-84a5-96f9d7d87ee2: deleting Apr 09 13:35:06 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77" returned: 0 in 0.569s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 9d3b5f2a-1fa8-4f8c-84a5-96f9d7d87ee2: deleting {{(pid=82346) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc38b0b-d227-42fb-ba10-c23920ea6c6d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-2ce35b1c-104e-4843-b363-276e943bd26d" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-2ce35b1c-104e-4843-b363-276e943bd26d" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-7067901b-5730-4535-9c36-e217b43e2047" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-7067901b-5730-4535-9c36-e217b43e2047" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Deleting offline snapshot 7067901b-5730-4535-9c36-e217b43e2047 of volume 2ce35b1c-104e-4843-b363-276e943bd26d {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] snapshot_file for this snap is: volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[601cfd56-d76c-4f83-9e2e-dc1a428f01e4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:06 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 Apr 09 13:35:06 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:06 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.eeb5905f-67f1-4bdd-bb10-057f5f081a61" returned: 0 in 0.440s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-eeb5905f-67f1-4bdd-bb10-057f5f081a61" released by "_delete_snapshot" :: held 2.048s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" released by "delete_snapshot" :: held 2.063s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:06 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 Apr 09 13:35:06 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Created reservations ['ba26ebcf-f32f-4e84-b7e7-fd3cbdd79d6e', 'a4cd4175-668a-4075-be35-33bd8ff4d994', '2bd9a023-343a-4f9e-8441-37ffe77b78ae', 'b4db465e-d2ec-4b21-844b-969ccd8d8b77'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:06 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Delete snapshot completed successfully. Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a56cfc4a-4774-4826-bc87-df7f9c09d6d5 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-eeb5905f-67f1-4bdd-bb10-057f5f081a61-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:06 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77" returned: 0 in 0.533s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:06 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img Apr 09 13:35:06 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:06 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047" returned: 0 in 0.526s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ce35b1c-104e-4843-b363-276e943bd26d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce34638-0c22-4488-9990-4c2ad6b96b9e]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:06 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d Apr 09 13:35:06 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "cinder-b8110c86-ea26-479f-aa78-ed8201fe5030-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-b8110c86-ea26-479f-aa78-ed8201fe5030-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "cinder-quobyte-b8110c86-ea26-479f-aa78-ed8201fe5030" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-b8110c86-ea26-479f-aa78-ed8201fe5030" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Deleting offline snapshot b8110c86-ea26-479f-aa78-ed8201fe5030 of volume 7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] snapshot_file for this snap is: volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efa68a9-afd6-460e-980e-defe524a0fb3]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:07 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d" returned: 0 in 0.919s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:07 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 Apr 09 13:35:07 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:07 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 Apr 09 13:35:07 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:08 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img" returned: 0 in 2.054s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:08 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[88af62f5-1fd5-4d01-81c4-0991d6f535bd]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:08 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 Apr 09 13:35:08 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:08 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047" returned: 0 in 1.212s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:08 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030" returned: 0 in 1.281s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:08 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047 Apr 09 13:35:08 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:08 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b27842d-8620-477a-af3d-1eeb5973c64f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:08 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe Apr 09 13:35:08 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:09 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d.7067901b-5730-4535-9c36-e217b43e2047" returned: 0 in 0.461s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-7067901b-5730-4535-9c36-e217b43e2047" released by "_delete_snapshot" :: held 3.197s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-2ce35b1c-104e-4843-b363-276e943bd26d" released by "delete_snapshot" :: held 3.212s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-10996e63-1b30-4121-b711-dae80e90a826" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-10996e63-1b30-4121-b711-dae80e90a826" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-922bd4f1-3ae8-4645-b474-bb12a86354af" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-922bd4f1-3ae8-4645-b474-bb12a86354af" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:09 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Deleting offline snapshot 922bd4f1-3ae8-4645-b474-bb12a86354af of volume 10996e63-1b30-4121-b711-dae80e90a826 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] snapshot_file for this snap is: volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77" returned: 0 in 0.684s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77, size 1024.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:35:09 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Converted 1024.00 MB image at 498.31 MB/s Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b26becb-fd9a-48a0-979d-0240d8ec5541]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:09 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe" returned: 0 in 0.530s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] f8c50ecd-5c43-4e98-861e-7f02ffe981cc was raw, converting to qcow2 {{(pid=82346) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 09 13:35:09 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 Apr 09 13:35:09 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b55a978-ea56-4bac-9aa5-18d6be4fac89]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:09 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af Apr 09 13:35:09 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:09 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img Apr 09 13:35:09 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:09 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030" returned: 0 in 0.470s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:09 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030 Apr 09 13:35:09 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:09 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af" returned: 0 in 0.534s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10996e63-1b30-4121-b711-dae80e90a826(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f9d60-dfff-4427-8202-f6ed3c929235]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:09 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img" returned: 0 in 0.500s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:09 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 Apr 09 13:35:09 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:09 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img Apr 09 13:35:09 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:10 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe.b8110c86-ea26-479f-aa78-ed8201fe5030" returned: 0 in 0.443s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-b8110c86-ea26-479f-aa78-ed8201fe5030" released by "_delete_snapshot" :: held 2.815s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" released by "delete_snapshot" :: held 2.837s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Created reservations ['bed02eda-d4e4-4f68-a420-63289e54d975', '31243aeb-bbcc-4679-b6ea-75e79d4c77c8', '4574aa5c-e139-41c1-9d83-8d3e5475d636', '99f93ca0-640f-49c3-8614-f33bb01ff240'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:10 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img" returned: 1 in 0.506s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img /opt/stack/data/cinder/conversion/vol_upload_hxeh51xb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:10 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img /opt/stack/data/cinder/conversion/vol_upload_hxeh51xb Apr 09 13:35:10 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:10 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826" returned: 0 in 0.555s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:10 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Delete snapshot completed successfully. Apr 09 13:35:10 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af Apr 09 13:35:10 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-49bfbe28-009b-49cc-9bdb-70469c72222f tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-b8110c86-ea26-479f-aa78-ed8201fe5030-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "cinder-7ca13387-04ea-46b0-9aee-449cb0e1edfe-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-7ca13387-04ea-46b0-9aee-449cb0e1edfe-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4966c1-1123-4cb1-92da-f14012c6528a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:10 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe Apr 09 13:35:10 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:10 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img /opt/stack/data/cinder/conversion/vol_upload_hxeh51xb" returned: 0 in 0.481s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Image conversion details: src /opt/stack/data/cinder/conversion/4f917618-c0c2-4dd6-a653-7ef97e69eb77.temp_image.f8c50ecd-5c43-4e98-861e-7f02ffe981ccz7eik8lh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hxeh51xb {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:35:10 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c73986-5cc3-4c62-b815-105857f0dca4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hxeh51xb {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:10 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hxeh51xb Apr 09 13:35:10 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:10 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af" returned: 0 in 0.537s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:11 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af Apr 09 13:35:11 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:11 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe" returned: 0 in 0.494s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:11 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe Apr 09 13:35:11 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:11 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hxeh51xb" returned: 0 in 0.489s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:11 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826.922bd4f1-3ae8-4645-b474-bb12a86354af" returned: 0 in 0.445s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-922bd4f1-3ae8-4645-b474-bb12a86354af" released by "_delete_snapshot" :: held 2.127s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-10996e63-1b30-4121-b711-dae80e90a826" released by "delete_snapshot" :: held 2.138s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:11 devstack cinder-volume[82346]: WARNING cinder.quota [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1699294617 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1699294617, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:35:11 devstack cinder-volume[82346]: WARNING cinder.quota [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1699294617 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1699294617, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['bd9bb76d-76f3-4105-b184-45dc0fc6f78a', 'a98c6a10-9a0d-4f22-97d9-751058b5cad4', 'e4ed4247-4da0-4fd6-8efe-b1f4a20dd70b', 'aefbaaee-7308-4a27-8b57-26d1817ec4a1'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['ab09b519-823b-452a-9c07-feacb9082901', '244ceb2f-a3ff-4df9-bd45-66f5f68f44fc', 'bad8b42c-4778-4616-8f56-e034b4058538', 'dca2cc3c-3288-46ab-ad0c-299705ef3733'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:11 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6d1260ff-b4cf-4d3d-9fec-25d330425ae7 tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 9d3b5f2a-1fa8-4f8c-84a5-96f9d7d87ee2: deleted successfully Apr 09 13:35:11 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7ca13387-04ea-46b0-9aee-449cb0e1edfe" returned: 0 in 0.449s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-quobyte-7ca13387-04ea-46b0-9aee-449cb0e1edfe" released by "delete_volume" :: held 0.980s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Created reservations ['787631e7-5094-4a9e-8fdb-b5bc6d55b49c', 'f042f47b-b6f6-4835-9bf5-eb6c25b96b3e', '06bd776e-9c65-458a-8781-a8c65b3fd4f5', 'bfc85789-1f2b-4292-93e4-b42dc45f38f2'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:11 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:11 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:12 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.478s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:12 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:12 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Deleted volume successfully. Apr 09 13:35:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-422d8e4a-7fd0-4ee8-9d2f-4e1f45788ed2 tempest-VolumesSnapshotListTestJSON-2040846348 None] Lock "cinder-7ca13387-04ea-46b0-9aee-449cb0e1edfe-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.892s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Uploaded volume to glance image-id: f8c50ecd-5c43-4e98-861e-7f02ffe981cc. {{(pid=82346) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 09 13:35:12 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d883d756-9d60-4919-b15a-b4acf372a965 tempest-VolumesActionsTest-1792904640 None] Copy volume to image completed successfully. Apr 09 13:35:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-10996e63-1b30-4121-b711-dae80e90a826" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-10996e63-1b30-4121-b711-dae80e90a826" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:12 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b63dae-41bc-4a81-86b4-39114d7c0c08]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:12 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 Apr 09 13:35:12 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:13 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826" returned: 0 in 0.494s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:13 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826 Apr 09 13:35:13 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (f50db55d-3266-4e9b-bf30-6fab3e92bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06510bfa-8569-400e-8ab4-00472e815657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06510bfa-8569-400e-8ab4-00472e815657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349769524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3191b7-f42a-4ff3-80b4-ab3e118c8e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:14Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746d9c32-747c-40ee-a648-aa0113235a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746d9c32-747c-40ee-a648-aa0113235a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43e8d57-c70f-465c-92d4-04d95f0e4d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43e8d57-c70f-465c-92d4-04d95f0e4d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d3191b7-f42a-4ff3-80b4-ab3e118c8e12', 'volume_name': 'volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98e2539-b7bf-4d5b-86bb-da9aff676961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98e2539-b7bf-4d5b-86bb-da9aff676961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be32e5c-b2d0-42e7-85e2-25e0e83fad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:13 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume 9d3191b7-f42a-4ff3-80b4-ab3e118c8e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12', 'volume_size': 1} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349769524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3191b7-f42a-4ff3-80b4-ab3e118c8e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:14Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Creating volume 9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:35:13 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Acquiring lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:13 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 1073741824 Apr 09 13:35:13 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:13 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-10996e63-1b30-4121-b711-dae80e90a826" returned: 0 in 0.494s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Acquiring lock "cinder-quobyte-4f917618-c0c2-4dd6-a653-7ef97e69eb77" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-10996e63-1b30-4121-b711-dae80e90a826" released by "delete_volume" :: held 1.031s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-2ce35b1c-104e-4843-b363-276e943bd26d" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Lock "cinder-quobyte-4f917618-c0c2-4dd6-a653-7ef97e69eb77" acquired by "delete_volume" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b582a9-d8e6-49e5-a2ba-934d0a5f46dd]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-2ce35b1c-104e-4843-b363-276e943bd26d" acquired by "delete_volume" :: waited 0.026s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b440f7-c811-464e-a0f6-0750133484b3]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:13 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 Apr 09 13:35:13 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:13 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d Apr 09 13:35:13 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:14 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 1073741824" returned: 0 in 0.509s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:14 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 Apr 09 13:35:14 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:14 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d" returned: 0 in 0.496s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:14 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77" returned: 0 in 0.544s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:14 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d Apr 09 13:35:14 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:14 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77 Apr 09 13:35:14 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:14 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12" returned: 0 in 0.449s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be32e5c-b2d0-42e7-85e2-25e0e83fad6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9944dd26-5069-496f-89cd-226def7bd9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:14 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 (9d3191b7-f42a-4ff3-80b4-ab3e118c8e12): created successfully Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9944dd26-5069-496f-89cd-226def7bd9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (f50db55d-3266-4e9b-bf30-6fab3e92bf79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:14 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2ce35b1c-104e-4843-b363-276e943bd26d" returned: 0 in 0.410s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:14 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-1dba3132-4a28-44c9-8df6-8a6e881515b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created volume successfully. Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-2ce35b1c-104e-4843-b363-276e943bd26d" released by "delete_volume" :: held 0.942s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['f9052bcd-dc36-4871-8717-da6781ea4e04'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:14 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f917618-c0c2-4dd6-a653-7ef97e69eb77" returned: 0 in 0.466s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Lock "cinder-quobyte-4f917618-c0c2-4dd6-a653-7ef97e69eb77" released by "delete_volume" :: held 1.033s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:14 devstack cinder-volume[82346]: WARNING cinder.quota [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1699294617 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1699294617, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['d3a3d325-3bea-4ee7-9d74-16112c32bb24', 'e050eea3-080f-4081-8083-11aae3fb1c44', '61fccbbc-c1e6-410a-882f-8d9c4628e6ed', '6a68085a-212e-4673-a014-1fb5041ad201'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Created reservations ['d536e1d2-1dbf-495f-a5fb-da995511c826', '6ff6c530-e691-42bf-9acf-7152c4e81340', '25e06053-babd-45b9-93c7-2518e52e805a', 'f3ddcb1f-1b24-4915-b218-266173938722'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:14 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:14 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:14 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['304285af-2de5-4140-acb7-5d5b3fd25443', '57b1de85-8e54-4d7b-ae86-fc8ca8baf313', 'c8524c54-a296-452f-8670-36b5f153bb71', '4b413009-33df-4f26-b9cb-a0b1eb9b57b2'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:15 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:15 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:15 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.407s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:15 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Deleted volume successfully. Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4d433a72-dd62-4cc3-ae77-857a0cbb5857 tempest-VolumesActionsTest-1792904640 None] Lock "cinder-4f917618-c0c2-4dd6-a653-7ef97e69eb77-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:15 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.402s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:15 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ee1f54c1-1c2f-4de9-8abd-f3ac9f3a542e tempest-GroupSnapshotsTest-1499236982 None] Delete group completed successfully. Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] Creating offline snapshot cceb2704-39ab-44fc-be1d-aea11d30a487 of volume 9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f463780-ae85-4d4a-b8a3-140a9ebfcc80]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:15 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 Apr 09 13:35:15 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:16 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d4082034-b0b3-41eb-a889-9bbe5d7b9f39 tempest-GroupSnapshotsTest-1499236982 None] Group tempest-GroupSnapshotsTest-Group-1378300101: creating Apr 09 13:35:16 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d4082034-b0b3-41eb-a889-9bbe5d7b9f39 tempest-GroupSnapshotsTest-1499236982 None] Group tempest-GroupSnapshotsTest-Group-1378300101: created successfully Apr 09 13:35:16 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d4082034-b0b3-41eb-a889-9bbe5d7b9f39 tempest-GroupSnapshotsTest-1499236982 None] Create group completed successfully. Apr 09 13:35:16 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12" returned: 0 in 0.615s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:16 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 1G Apr 09 13:35:16 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:17 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 1G" returned: 0 in 0.559s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:17 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 Apr 09 13:35:17 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:17 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487" returned: 0 in 0.517s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:17 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 is being set with open permissions: ugo+rw Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:17 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 Apr 09 13:35:17 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Flow 'volume_create_manager' (01500fa3-000b-4415-9803-02557e407b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b99fa0-7fc3-421e-a9a5-1f4484f8ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b99fa0-7fc3-421e-a9a5-1f4484f8ffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067850007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ebcb8bfa-93bb-41c7-8c09-45a27112a146,host='devstack@QuobyteHD#QuobyteHD',id=99f5933a-c5fd-4eb7-ad52-f8be4adee118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4862ef611c4c3a9aac3bd9d1a5cd25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:18Z,use_quota=True,user_id='4732c034fda84b85b8b642d98670b1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29d6f3bd-14bf-49cf-81d6-ea2aba1b652f),volume_type_id=29d6f3bd-14bf-49cf-81d6-ea2aba1b652f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecae7057-eb2e-4625-a544-852ce48c6120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecae7057-eb2e-4625-a544-852ce48c6120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6147fe-be60-401c-a329-0505d84552bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6147fe-be60-401c-a329-0505d84552bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99f5933a-c5fd-4eb7-ad52-f8be4adee118', 'volume_name': 'volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973ae5aa-dd04-433c-9f70-a91ec81a8f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973ae5aa-dd04-433c-9f70-a91ec81a8f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177793ba-08e1-414a-b42c-13ccf9413d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:17 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Volume 99f5933a-c5fd-4eb7-ad52-f8be4adee118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118', 'volume_size': 1} Apr 09 13:35:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:18 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487" returned: 0 in 0.510s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:18 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.info Apr 09 13:35:18 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:18 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.info" returned: 0 in 0.482s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:18 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.info is being set with open permissions: ugo+rw Apr 09 13:35:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:18 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.info Apr 09 13:35:18 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:19 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.info" returned: 0 in 0.474s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.209s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.360s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ebcb8bfa-93bb-41c7-8c09-45a27112a146,created_at=2026-04-09T11:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067850007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ebcb8bfa-93bb-41c7-8c09-45a27112a146,host='devstack@QuobyteHD#QuobyteHD',id=99f5933a-c5fd-4eb7-ad52-f8be4adee118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4862ef611c4c3a9aac3bd9d1a5cd25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:18Z,use_quota=True,user_id='4732c034fda84b85b8b642d98670b1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29d6f3bd-14bf-49cf-81d6-ea2aba1b652f),volume_type_id=29d6f3bd-14bf-49cf-81d6-ea2aba1b652f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Creating volume 99f5933a-c5fd-4eb7-ad52-f8be4adee118 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:35:19 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:19 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 1073741824 Apr 09 13:35:19 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:19 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-433e4f24-837e-42bf-8f1b-159dabcb038c tempest-CreateVolumesFromSnapshotTest-1820614559 None] Create snapshot completed successfully Apr 09 13:35:19 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 1073741824" returned: 0 in 0.517s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:19 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 Apr 09 13:35:19 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Flow 'volume_create_manager' (5520dc30-e209-4bfa-9cb7-aced9d5032fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9b87da-c424-408a-8855-049546e9a185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9b87da-c424-408a-8855-049546e9a185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-41079538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7ae8b2-713c-4eef-abe1-49b940b0b803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a315037c858449ab75eaebaa25d36fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:20Z,use_quota=True,user_id='ac33fa456f8e44b7aaa875c96a7c6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a72ab66-5be7-4e48-a5d9-e3643bf3587f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a72ab66-5be7-4e48-a5d9-e3643bf3587f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49008f9-f352-42c1-8861-3ee1c644d031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49008f9-f352-42c1-8861-3ee1c644d031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c7ae8b2-713c-4eef-abe1-49b940b0b803', 'volume_name': 'volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3daa0dd5-73f3-41a8-840d-5b186565c40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3daa0dd5-73f3-41a8-840d-5b186565c40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e5f47a-1236-4ea5-83d6-3b0f405c0d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:19 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Volume 2c7ae8b2-713c-4eef-abe1-49b940b0b803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803', 'volume_size': 1} Apr 09 13:35:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:20 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118" returned: 0 in 0.469s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.167s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-41079538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7ae8b2-713c-4eef-abe1-49b940b0b803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a315037c858449ab75eaebaa25d36fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:20Z,use_quota=True,user_id='ac33fa456f8e44b7aaa875c96a7c6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Creating volume 2c7ae8b2-713c-4eef-abe1-49b940b0b803 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:35:20 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177793ba-08e1-414a-b42c-13ccf9413d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19370a2-4bce-4bc4-a42f-8f41ea18fdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 1073741824 Apr 09 13:35:20 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Volume volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 (99f5933a-c5fd-4eb7-ad52-f8be4adee118): created successfully Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19370a2-4bce-4bc4-a42f-8f41ea18fdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Flow 'volume_create_manager' (01500fa3-000b-4415-9803-02557e407b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:20 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2315a874-25ea-406e-961c-b54426762af5 tempest-GroupSnapshotsTest-1499236982 None] Created volume successfully. Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (d07d3c5e-d550-4e72-82bb-a331b08b6973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9922f5-9969-4347-a054-524d8d344992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9922f5-9969-4347-a054-524d8d344992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1380795021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ae2ff5-461d-4f60-a411-6a2cde36afa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:20Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e01e0e2-8863-450c-bbc0-dc8fe25b2e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e01e0e2-8863-450c-bbc0-dc8fe25b2e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae805abe-b513-434a-88b0-0aa0f4d013b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae805abe-b513-434a-88b0-0aa0f4d013b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ae2ff5-461d-4f60-a411-6a2cde36afa2', 'volume_name': 'volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713a7145-a659-4930-b3c9-20d902a1e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713a7145-a659-4930-b3c9-20d902a1e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0568158a-8104-418a-8858-04c35b23b2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume 05ae2ff5-461d-4f60-a411-6a2cde36afa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2', 'volume_size': 1} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (7a7f06e2-81a9-4176-b871-f2558123719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e8a2af-054d-4885-9fd7-4c8ac16573ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e8a2af-054d-4885-9fd7-4c8ac16573ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1598324217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303ec380-50de-4c8e-8938-4c732f1e2d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:20Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b08209-4e53-4bc2-ae93-a72fcc6dac41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b08209-4e53-4bc2-ae93-a72fcc6dac41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164edbf7-f26f-4285-ac31-50e6163e9780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164edbf7-f26f-4285-ac31-50e6163e9780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '303ec380-50de-4c8e-8938-4c732f1e2d8f', 'volume_name': 'volume-303ec380-50de-4c8e-8938-4c732f1e2d8f', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dee96a6-17ec-4870-802f-16565af12ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dee96a6-17ec-4870-802f-16565af12ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ad7f80-73dc-4e5c-b79c-c9a02cc6976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume 303ec380-50de-4c8e-8938-4c732f1e2d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-303ec380-50de-4c8e-8938-4c732f1e2d8f', 'volume_size': 1} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (eedb30ff-b3b5-4bff-bcae-108df2f3d321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555450a9-17b0-4b6c-8258-af4796156e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555450a9-17b0-4b6c-8258-af4796156e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1513862388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b4ceec-7627-4f38-bfe2-4a1a56ebf915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:21Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a76fbae-8aa8-4c58-a915-6a7e4eee6f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a76fbae-8aa8-4c58-a915-6a7e4eee6f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cce2e8-9d9a-4686-8c98-42116aa4ba0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7cce2e8-9d9a-4686-8c98-42116aa4ba0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b4ceec-7627-4f38-bfe2-4a1a56ebf915', 'volume_name': 'volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9515806e-c248-4c74-ac79-6ec29c72825f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9515806e-c248-4c74-ac79-6ec29c72825f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0793f234-32eb-4e4a-a34f-27f34bce0e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume 79b4ceec-7627-4f38-bfe2-4a1a56ebf915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915', 'volume_size': 1} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 1073741824" returned: 0 in 0.573s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:20 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 Apr 09 13:35:20 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (4abffd7e-ee8b-4df5-a7bf-2055206744fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb7b7b9-8acd-41ab-ab96-ee22bd65f2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb7b7b9-8acd-41ab-ab96-ee22bd65f2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024795178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5708afcc-38a2-4d40-ba18-e82da5cc8fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:21Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcea69aa-6673-45e7-a8ad-38a4ce99d435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcea69aa-6673-45e7-a8ad-38a4ce99d435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37eb4c3e-5337-4ebe-b7be-34239f069b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37eb4c3e-5337-4ebe-b7be-34239f069b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5708afcc-38a2-4d40-ba18-e82da5cc8fde', 'volume_name': 'volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faef7ee0-31be-4be4-a17a-1dc8425d2d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faef7ee0-31be-4be4-a17a-1dc8425d2d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29842cd-942a-4c67-a54a-def9e6f7e480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume 5708afcc-38a2-4d40-ba18-e82da5cc8fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde', 'volume_size': 1} Apr 09 13:35:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (391252df-fd60-47c2-8a69-d344a4d2001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885a1ceb-8d3b-4ae6-b5be-946bf2af5f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:21 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] GroupSnapshot 4aa53cca-11d6-4ac5-9b07-f4d42593d28f: creating. Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885a1ceb-8d3b-4ae6-b5be-946bf2af5f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2074993656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651e6818-05ed-49f2-9926-06be7c566dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:21Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ec74e6-fc30-4166-941e-396a48a491f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ec74e6-fc30-4166-941e-396a48a491f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368a00bb-0c6e-4e36-b179-962901e4ce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368a00bb-0c6e-4e36-b179-962901e4ce94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651e6818-05ed-49f2-9926-06be7c566dcd', 'volume_name': 'volume-651e6818-05ed-49f2-9926-06be7c566dcd', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51759313-881d-439c-8f8c-c6b431f6e105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51759313-881d-439c-8f8c-c6b431f6e105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4bf47f-dd32-442b-aa2a-f86655a31226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:21 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume 651e6818-05ed-49f2-9926-06be7c566dcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651e6818-05ed-49f2-9926-06be7c566dcd', 'volume_size': 1} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] Group snapshot 4aa53cca-11d6-4ac5-9b07-f4d42593d28f: creating. {{(pid=82346) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:21 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803" returned: 0 in 0.506s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.825s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1380795021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ae2ff5-461d-4f60-a411-6a2cde36afa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:20Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Creating volume 05ae2ff5-461d-4f60-a411-6a2cde36afa2 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:35:21 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e5f47a-1236-4ea5-83d6-3b0f405c0d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:21 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2 1073741824 Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3639049-2c47-4236-a936-856a07eda6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:21 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:21 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Volume volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 (2c7ae8b2-713c-4eef-abe1-49b940b0b803): created successfully Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3639049-2c47-4236-a936-856a07eda6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Flow 'volume_create_manager' (5520dc30-e209-4bfa-9cb7-aced9d5032fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:21 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-4b4fabbd-0d92-405c-9dfd-00629a8ae850 tempest-VolumesCloneTest-2009230866 None] Created volume successfully. Apr 09 13:35:21 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2 1073741824" returned: 0 in 0.479s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:21 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2 Apr 09 13:35:21 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:22 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2" returned: 0 in 0.437s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.679s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1598324217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303ec380-50de-4c8e-8938-4c732f1e2d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:20Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Creating volume 303ec380-50de-4c8e-8938-4c732f1e2d8f {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:35:22 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0568158a-8104-418a-8858-04c35b23b2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:22 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f 1073741824 Apr 09 13:35:22 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa02741d-8847-4fa9-90fd-4a1480393c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:22 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2 (05ae2ff5-461d-4f60-a411-6a2cde36afa2): created successfully Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa02741d-8847-4fa9-90fd-4a1480393c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (d07d3c5e-d550-4e72-82bb-a331b08b6973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:22 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-446e5f15-ba36-480c-b876-8aa51b90a7b4 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created volume successfully. Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Flow 'volume_create_manager' (b4b306bd-6fdb-49b9-8142-06ac482a8be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5eab0f-25ad-4793-82fe-247dfda1dcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5eab0f-25ad-4793-82fe-247dfda1dcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1626312993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd02d124-e1d3-4d4d-8c82-8f526c2cde08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a315037c858449ab75eaebaa25d36fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2c7ae8b2-713c-4eef-abe1-49b940b0b803,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:22Z,use_quota=True,user_id='ac33fa456f8e44b7aaa875c96a7c6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d98779-b264-40ce-b7c6-5bac5bcb0b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d98779-b264-40ce-b7c6-5bac5bcb0b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d268d624-d339-4632-a3fc-53ce702f65f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d268d624-d339-4632-a3fc-53ce702f65f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cd02d124-e1d3-4d4d-8c82-8f526c2cde08', 'volume_name': 'volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08', 'volume_size': 2, 'source_volid': '2c7ae8b2-713c-4eef-abe1-49b940b0b803', 'source_volstatus': 'available'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124e492e-3590-4e22-8315-72cb63474693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124e492e-3590-4e22-8315-72cb63474693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60844c6f-f607-47aa-8b2a-2a5533181ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:22 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Volume cd02d124-e1d3-4d4d-8c82-8f526c2cde08: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08', 'volume_size': 2, 'source_volid': '2c7ae8b2-713c-4eef-abe1-49b940b0b803', 'source_volstatus': 'available'} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:22 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f 1073741824" returned: 0 in 0.479s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:22 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f Apr 09 13:35:22 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:23 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f" returned: 0 in 0.412s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.399s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1513862388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b4ceec-7627-4f38-bfe2-4a1a56ebf915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:21Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Creating volume 79b4ceec-7627-4f38-bfe2-4a1a56ebf915 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:35:23 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ad7f80-73dc-4e5c-b79c-c9a02cc6976b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303ec380-50de-4c8e-8938-4c732f1e2d8f', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:23 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915 1073741824 Apr 09 13:35:23 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b61b195-c62f-4f93-a9c2-6b1966e1c71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:23 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume volume-303ec380-50de-4c8e-8938-4c732f1e2d8f (303ec380-50de-4c8e-8938-4c732f1e2d8f): created successfully Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b61b195-c62f-4f93-a9c2-6b1966e1c71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (7a7f06e2-81a9-4176-b871-f2558123719c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:23 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-bd101695-34c6-47e3-ba6f-1fcbc6694d4e tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created volume successfully. Apr 09 13:35:23 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915 1073741824" returned: 0 in 0.512s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:23 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915 Apr 09 13:35:23 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:23 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915" returned: 0 in 0.392s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:35:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.112s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024795178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5708afcc-38a2-4d40-ba18-e82da5cc8fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:21Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Creating volume 5708afcc-38a2-4d40-ba18-e82da5cc8fde {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:35:24 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0793f234-32eb-4e4a-a34f-27f34bce0e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:24 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde 1073741824 Apr 09 13:35:24 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15659b3c-f8bd-47b8-b2f9-f2dbe261226b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:24 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915 (79b4ceec-7627-4f38-bfe2-4a1a56ebf915): created successfully Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15659b3c-f8bd-47b8-b2f9-f2dbe261226b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (eedb30ff-b3b5-4bff-bcae-108df2f3d321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:24 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-966bc418-ce17-4218-a338-4076e4755acb tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created volume successfully. Apr 09 13:35:24 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde 1073741824" returned: 0 in 0.477s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:24 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde Apr 09 13:35:24 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:24 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde" returned: 0 in 0.405s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.794s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2074993656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651e6818-05ed-49f2-9926-06be7c566dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc07a1de7d84a858dce8f4522073eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:21Z,use_quota=True,user_id='31e95c75a1fe43af83aa7d7052c8793c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Creating volume 651e6818-05ed-49f2-9926-06be7c566dcd {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:35:24 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29842cd-942a-4c67-a54a-def9e6f7e480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:24 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd 1073741824 Apr 09 13:35:24 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c974c62b-e990-489c-ab96-b46e065cb6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:24 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde (5708afcc-38a2-4d40-ba18-e82da5cc8fde): created successfully Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c974c62b-e990-489c-ab96-b46e065cb6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (4abffd7e-ee8b-4df5-a7bf-2055206744fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:24 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d6459e54-6be2-496d-b0ae-c801c0150d35 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created volume successfully. Apr 09 13:35:25 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd 1073741824" returned: 0 in 0.469s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:25 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd Apr 09 13:35:25 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:25 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd" returned: 0 in 0.393s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.678s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4bf47f-dd32-442b-aa2a-f86655a31226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651e6818-05ed-49f2-9926-06be7c566dcd', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4ff5a1-0ec2-4b53-a05e-c22bb4127a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] Creating offline snapshot ba2788ed-bb78-47c6-9cca-40503062e679 of volume 99f5933a-c5fd-4eb7-ad52-f8be4adee118 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:35:25 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Volume volume-651e6818-05ed-49f2-9926-06be7c566dcd (651e6818-05ed-49f2-9926-06be7c566dcd): created successfully Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4ff5a1-0ec2-4b53-a05e-c22bb4127a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Flow 'volume_create_manager' (391252df-fd60-47c2-8a69-d344a4d2001d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd655db-14f8-4106-bc00-d976985d98d0]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:25 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d18b5b6d-07e6-482c-9f63-c913bec83397 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created volume successfully. Apr 09 13:35:25 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 Apr 09 13:35:25 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:26 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118" returned: 0 in 0.463s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:26 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 1G Apr 09 13:35:26 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-651e6818-05ed-49f2-9926-06be7c566dcd-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-651e6818-05ed-49f2-9926-06be7c566dcd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-quobyte-651e6818-05ed-49f2-9926-06be7c566dcd" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-651e6818-05ed-49f2-9926-06be7c566dcd" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:26 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6838aab-fb46-4fab-a07f-1e9beaa64fa8]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:26 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd Apr 09 13:35:26 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:26 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 1G" returned: 0 in 0.524s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:26 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 Apr 09 13:35:26 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:27 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd" returned: 0 in 0.496s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:27 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd Apr 09 13:35:27 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:27 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679" returned: 0 in 0.449s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:27 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:27 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 Apr 09 13:35:27 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:27 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-651e6818-05ed-49f2-9926-06be7c566dcd" returned: 0 in 0.430s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-651e6818-05ed-49f2-9926-06be7c566dcd" released by "delete_volume" :: held 0.954s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created reservations ['dc76307c-461c-4acd-8d14-5483c82dff29', '10f5cb3b-8b4d-45f0-81de-d31751a9a942', '9fb320af-f68d-487e-ad94-568fdc50e322', '395587bb-24c0-4b9e-bbc8-2364ec8b5d58'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:27 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:27 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-5708afcc-38a2-4d40-ba18-e82da5cc8fde-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-5708afcc-38a2-4d40-ba18-e82da5cc8fde-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-quobyte-5708afcc-38a2-4d40-ba18-e82da5cc8fde" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-5708afcc-38a2-4d40-ba18-e82da5cc8fde" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[725611b1-c65c-4019-9429-3d41f1effa87]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:27 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679" returned: 0 in 0.499s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:27 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.info Apr 09 13:35:27 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:27 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde Apr 09 13:35:27 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:28 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.486s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:28 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Deleted volume successfully. Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ebf0c729-20db-456f-81f1-ae60ba064e6d tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-651e6818-05ed-49f2-9926-06be7c566dcd-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:28 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.info" returned: 0 in 0.425s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:28 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:28 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.info Apr 09 13:35:28 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:28 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde" returned: 0 in 0.515s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:28 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde Apr 09 13:35:28 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:28 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.info" returned: 0 in 0.446s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.884s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.386s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:28 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Cloning volume 2c7ae8b2-713c-4eef-abe1-49b940b0b803 to volume cd02d124-e1d3-4d4d-8c82-8f526c2cde08 Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Creating offline snapshot 1a8910f8-1b3f-4170-a095-2379a16e8d4c of volume 2c7ae8b2-713c-4eef-abe1-49b940b0b803 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:35:28 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-5708afcc-38a2-4d40-ba18-e82da5cc8fde" returned: 0 in 0.456s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab4a774-731d-4a20-a532-0961ac25aa2a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:28 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d383820a-8f99-453a-befa-734edde163e2 tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 4aa53cca-11d6-4ac5-9b07-f4d42593d28f: created successfully Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-5708afcc-38a2-4d40-ba18-e82da5cc8fde" released by "delete_volume" :: held 1.017s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created reservations ['6578b51a-6d0f-40bb-93f2-401eb03cd300', 'bf108d05-dc82-4247-866c-2a95812b1036', '6ef0d2f3-8687-4fde-a287-8579297421c3', 'd5f6e7e4-7108-4625-b319-61d8b7fffacc'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=190,cinder:UPDATE=205,cinder:INSERT=34,cinder:DELETE=18 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=190,cinder:UPDATE=211,cinder:INSERT=69,cinder:DELETE=10 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:35:28 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 Apr 09 13:35:28 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:28 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:28 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:29 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803" returned: 0 in 0.504s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:29 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.412s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:29 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Deleted volume successfully. Apr 09 13:35:29 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c 1G Apr 09 13:35:29 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-01842f44-b0f4-420f-b1d4-3bcb78e46c18 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-5708afcc-38a2-4d40-ba18-e82da5cc8fde-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:29 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 4aa53cca-11d6-4ac5-9b07-f4d42593d28f: deleting Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 4aa53cca-11d6-4ac5-9b07-f4d42593d28f: deleting {{(pid=82346) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-99f5933a-c5fd-4eb7-ad52-f8be4adee118" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-99f5933a-c5fd-4eb7-ad52-f8be4adee118" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-ba2788ed-bb78-47c6-9cca-40503062e679" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-ba2788ed-bb78-47c6-9cca-40503062e679" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Deleting offline snapshot ba2788ed-bb78-47c6-9cca-40503062e679 of volume 99f5933a-c5fd-4eb7-ad52-f8be4adee118 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] snapshot_file for this snap is: volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5752798c-5b52-445e-bc12-6fa7e07c2872]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:29 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 Apr 09 13:35:29 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:29 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c 1G" returned: 0 in 0.512s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:29 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c Apr 09 13:35:29 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-79b4ceec-7627-4f38-bfe2-4a1a56ebf915-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-79b4ceec-7627-4f38-bfe2-4a1a56ebf915-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-quobyte-79b4ceec-7627-4f38-bfe2-4a1a56ebf915" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-79b4ceec-7627-4f38-bfe2-4a1a56ebf915" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbefd185-dc1b-49a4-9a51-a6d74c3143d7]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:30 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915 Apr 09 13:35:30 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:30 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679" returned: 0 in 0.537s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff39460-dae0-4aa2-8081-dd85793944e7]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:30 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 Apr 09 13:35:30 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:30 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c" returned: 0 in 0.448s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:30 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c is being set with open permissions: ugo+rw Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:30 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c Apr 09 13:35:30 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:30 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915" returned: 0 in 0.477s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:30 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915 Apr 09 13:35:30 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:30 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118" returned: 0 in 0.460s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:30 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 Apr 09 13:35:30 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:30 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c" returned: 0 in 0.430s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:30 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.info Apr 09 13:35:30 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:30 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-79b4ceec-7627-4f38-bfe2-4a1a56ebf915" returned: 0 in 0.411s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-79b4ceec-7627-4f38-bfe2-4a1a56ebf915" released by "delete_volume" :: held 0.911s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created reservations ['5c54515e-ec89-45bc-8ce4-475fdb9c60e7', 'e502dfe8-888d-40d1-ab0a-95e753a61510', 'c41e88ea-dbf4-494d-9ccb-68f571bcc6bc', 'ea1ef8e8-01c2-4e0a-ba76-6839e29e2e07'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:30 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:30 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-303ec380-50de-4c8e-8938-4c732f1e2d8f-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-303ec380-50de-4c8e-8938-4c732f1e2d8f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:31 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679" returned: 0 in 0.522s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:31 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679 Apr 09 13:35:31 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-quobyte-303ec380-50de-4c8e-8938-4c732f1e2d8f" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-303ec380-50de-4c8e-8938-4c732f1e2d8f" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e11f91-d076-4072-ac9b-79285bad304b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:31 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.info" returned: 0 in 0.466s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:31 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.info is being set with open permissions: ugo+rw Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:31 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.info Apr 09 13:35:31 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:31 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f Apr 09 13:35:31 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:31 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.475s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:31 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Deleted volume successfully. Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-026e9ac5-a5da-4a3a-b016-1ce90c675a69 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-79b4ceec-7627-4f38-bfe2-4a1a56ebf915-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:31 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118.ba2788ed-bb78-47c6-9cca-40503062e679" returned: 0 in 0.446s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-ba2788ed-bb78-47c6-9cca-40503062e679" released by "_delete_snapshot" :: held 2.034s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-99f5933a-c5fd-4eb7-ad52-f8be4adee118" released by "delete_snapshot" :: held 2.047s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:31 devstack cinder-volume[82346]: WARNING cinder.quota [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1017658749 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1017658749, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:35:31 devstack cinder-volume[82346]: WARNING cinder.quota [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1017658749 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1017658749, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['5b97345c-236e-46f7-9c1c-df8b96ee6b54', '2aecfaa0-0710-41f1-a885-9e2572c5946d', 'f353e640-3fbc-43d6-a9c8-47fbb62c7831', '5872b39b-b0d9-45ff-a7c9-beb3d908db48'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:31 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.info" returned: 0 in 0.457s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Acquiring lock "cinder-quobyte-cd02d124-e1d3-4d4d-8c82-8f526c2cde08" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:31 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f" returned: 0 in 0.520s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Lock "cinder-quobyte-cd02d124-e1d3-4d4d-8c82-8f526c2cde08" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] snapshot: 1a8910f8-1b3f-4170-a095-2379a16e8d4c, volume: cd02d124-e1d3-4d4d-8c82-8f526c2cde08, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:31 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:31 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e46035-bcbf-42b5-9075-3607846b9c1d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:31 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-69daabe3-e113-4ee0-a017-87a6859cdbd4 tempest-GroupSnapshotsTest-1499236982 None] group_snapshot 4aa53cca-11d6-4ac5-9b07-f4d42593d28f: deleted successfully Apr 09 13:35:31 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c Apr 09 13:35:31 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:32 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-303ec380-50de-4c8e-8938-4c732f1e2d8f" returned: 0 in 0.435s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-303ec380-50de-4c8e-8938-4c732f1e2d8f" released by "delete_volume" :: held 0.992s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created reservations ['6add5df7-d50c-4093-aba9-bc27e97af4e9', 'b90703d7-b9db-47df-832f-99fb54b675e8', '241cef45-b3c3-436c-abdd-ad4f7e6ca340', 'd4e7a311-3bbc-49b2-b0e2-c9eb28dd2762'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:32 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c" returned: 0 in 0.505s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c773f03-dc90-4957-a975-c40b5efe9abc]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:32 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:32 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:32 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 Apr 09 13:35:32 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:32 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.448s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:32 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Deleted volume successfully. Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-474b7e32-fe94-4582-bbd1-13e826aa248a tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-303ec380-50de-4c8e-8938-4c732f1e2d8f-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:32 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803" returned: 0 in 0.465s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:32 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 Apr 09 13:35:32 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "cinder-quobyte-99f5933a-c5fd-4eb7-ad52-f8be4adee118" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-99f5933a-c5fd-4eb7-ad52-f8be4adee118" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a13194d-16ed-4ba7-9177-5a7b0d6e8dbd]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:32 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 Apr 09 13:35:32 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG oslo_service.periodic_task [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82346) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-05ae2ff5-461d-4f60-a411-6a2cde36afa2-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-05ae2ff5-461d-4f60-a411-6a2cde36afa2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:33 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:33 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-quobyte-05ae2ff5-461d-4f60-a411-6a2cde36afa2" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-05ae2ff5-461d-4f60-a411-6a2cde36afa2" acquired by "delete_volume" :: waited 0.016s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[27068c9b-ee5f-46a9-89f9-4c3da44c9fca]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:33 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2 Apr 09 13:35:33 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:34 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118" returned: 0 in 1.440s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:34 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118 Apr 09 13:35:34 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:34 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 1.431s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:34 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:34 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08" returned: 0 in 2.145s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:34 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cab2997-3447-4476-b733-123e362b5646]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:34 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 Apr 09 13:35:34 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:34 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2" returned: 0 in 1.403s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:34 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2 Apr 09 13:35:34 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:35 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-99f5933a-c5fd-4eb7-ad52-f8be4adee118" returned: 0 in 0.685s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Lock "cinder-quobyte-99f5933a-c5fd-4eb7-ad52-f8be4adee118" released by "delete_volume" :: held 2.168s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['271b3f36-abbb-4f6d-a5f4-11ba821cb619'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:35 devstack cinder-volume[82346]: WARNING cinder.quota [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1017658749 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1017658749, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Created reservations ['ca9b8785-f989-48cb-ab9e-3133cfcaf6ae', '214224e0-fa29-43f3-a3d7-965c171fec07', 'a3122890-48af-4f01-b208-0d2a998af852', '1280723d-77de-4833-9ced-bf54227e413f'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:35 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:35 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:35 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-05ae2ff5-461d-4f60-a411-6a2cde36afa2" returned: 0 in 0.485s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-05ae2ff5-461d-4f60-a411-6a2cde36afa2" released by "delete_volume" :: held 1.932s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:35 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803" returned: 0 in 0.701s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:35:35 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Converted 1024.00 MB image at 477.23 MB/s Apr 09 13:35:35 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 is being set with open permissions: ugo+rw Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created reservations ['4ef9573a-604e-4277-b207-ef0465170a36', 'b9ab1e8c-edb7-40f7-8e57-d26f40d24214', '711da406-a2a1-4693-a953-bb28bab248d7', '9fde0332-9dca-43a9-8584-884deed8f78d'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:35 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 Apr 09 13:35:35 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:35 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:35 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:35 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.462s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-764b6601-ae7c-455c-83e1-a7c1f8bd24f1 tempest-GroupSnapshotsTest-1499236982 None] Delete group completed successfully. Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-cceb2704-39ab-44fc-be1d-aea11d30a487-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-cceb2704-39ab-44fc-be1d-aea11d30a487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-quobyte-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-quobyte-cceb2704-39ab-44fc-be1d-aea11d30a487" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-cceb2704-39ab-44fc-be1d-aea11d30a487" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Deleting offline snapshot cceb2704-39ab-44fc-be1d-aea11d30a487 of volume 9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] snapshot_file for this snap is: volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad06e200-20fd-43ba-b6e1-ac5eabd0b521]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:35 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 Apr 09 13:35:35 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:36 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08" returned: 0 in 0.501s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Lock "cinder-quobyte-cd02d124-e1d3-4d4d-8c82-8f526c2cde08" released by "_copy_volume_from_snapshot" :: held 4.369s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Acquiring lock "cinder-quobyte-1a8910f8-1b3f-4170-a095-2379a16e8d4c" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Lock "cinder-quobyte-1a8910f8-1b3f-4170-a095-2379a16e8d4c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:36 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Deleting offline snapshot 1a8910f8-1b3f-4170-a095-2379a16e8d4c of volume 2c7ae8b2-713c-4eef-abe1-49b940b0b803 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] snapshot_file for this snap is: volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.505s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:36 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Deleted volume successfully. Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b323a5b-618f-48cf-8986-a08b4dbbde7b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a263e973-b94a-4879-8d16-0398014ec42f tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-05ae2ff5-461d-4f60-a411-6a2cde36afa2-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:36 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c Apr 09 13:35:36 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:36 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487" returned: 0 in 0.591s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb3850-2de2-4aab-b7a4-880928e54882]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:36 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 Apr 09 13:35:36 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:36 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c" returned: 0 in 0.572s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a573d3-d1be-4982-916a-4d64711271aa]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:36 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 Apr 09 13:35:36 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:37 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12" returned: 0 in 0.561s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:37 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 Apr 09 13:35:37 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:37 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803" returned: 0 in 0.563s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:37 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c Apr 09 13:35:37 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:37 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487" returned: 0 in 0.506s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:37 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487 Apr 09 13:35:37 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:37 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c" returned: 0 in 0.546s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:37 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c Apr 09 13:35:37 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:38 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12.cceb2704-39ab-44fc-be1d-aea11d30a487" returned: 0 in 0.489s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-cceb2704-39ab-44fc-be1d-aea11d30a487" released by "_delete_snapshot" :: held 2.213s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12" released by "delete_snapshot" :: held 2.233s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created reservations ['4fc9173d-f7c3-4410-9be2-f771559d5e00', 'fc6287ba-f8b5-4fbb-af8b-a595234a7148', 'c2a87db1-edd1-4d4d-8d7e-a0100fc8ca43', 'a71a2231-c12f-447a-b433-28d6c4615854'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:38 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Delete snapshot completed successfully. Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b8c9a675-9c1c-42f8-b6d1-2f739b5401e5 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-cceb2704-39ab-44fc-be1d-aea11d30a487-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:38 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-c785006d-8376-41c4-b73a-c756b7d922a8 tempest-GroupSnapshotsV319Test-1665196533 None] Group tempest-GroupSnapshotsV319Test-Group-1585356312: creating Apr 09 13:35:38 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-c785006d-8376-41c4-b73a-c756b7d922a8 tempest-GroupSnapshotsV319Test-1665196533 None] Group tempest-GroupSnapshotsV319Test-Group-1585356312: created successfully Apr 09 13:35:38 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-c785006d-8376-41c4-b73a-c756b7d922a8 tempest-GroupSnapshotsV319Test-1665196533 None] Create group completed successfully. Apr 09 13:35:38 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803.1a8910f8-1b3f-4170-a095-2379a16e8d4c" returned: 0 in 0.500s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Lock "cinder-quobyte-1a8910f8-1b3f-4170-a095-2379a16e8d4c" released by "_delete_snapshot" :: held 2.246s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.622s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60844c6f-f607-47aa-8b2a-2a5533181ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08', 'volume_size': 2, 'source_volid': '2c7ae8b2-713c-4eef-abe1-49b940b0b803', 'source_volstatus': 'available'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fab8fa-0155-427c-842b-a5f493a14850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:38 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Volume volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 (cd02d124-e1d3-4d4d-8c82-8f526c2cde08): created successfully Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fab8fa-0155-427c-842b-a5f493a14850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Flow 'volume_create_manager' (b4b306bd-6fdb-49b9-8142-06ac482a8be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:38 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2b0bdd9f-9e61-4a4e-8aa9-9964011cb678 tempest-VolumesCloneTest-2009230866 None] Created volume successfully. Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "cinder-quobyte-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7a7ee8-7a73-4cfc-8280-2765d1616d4b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:39 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 Apr 09 13:35:39 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Acquiring lock "cinder-cd02d124-e1d3-4d4d-8c82-8f526c2cde08-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Lock "cinder-cd02d124-e1d3-4d4d-8c82-8f526c2cde08-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Acquiring lock "cinder-quobyte-cd02d124-e1d3-4d4d-8c82-8f526c2cde08" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Lock "cinder-quobyte-cd02d124-e1d3-4d4d-8c82-8f526c2cde08" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1d0f69-b0ca-49ff-a044-1900411a267b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:39 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12" returned: 0 in 0.562s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:39 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 Apr 09 13:35:39 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:39 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12 Apr 09 13:35:39 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Flow 'volume_create_manager' (b43235a5-8c57-43fb-86b0-a09127d13477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701cadab-f6e7-47d8-a0ae-47bb21d02dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701cadab-f6e7-47d8-a0ae-47bb21d02dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-884959828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e094c49-6e07-42e6-924c-627326587707,host='devstack@QuobyteHD#QuobyteHD',id=4bb4987f-205f-4723-8e39-0247163d478a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3972b4519579450da4581e3420fa5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:40Z,use_quota=True,user_id='69b1301c632945c8bf83296be10bbbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bab1b50e-c82c-45c3-998a-9558267e1e35),volume_type_id=bab1b50e-c82c-45c3-998a-9558267e1e35)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160d1282-f1f5-4034-859e-b9e5c7ed444b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160d1282-f1f5-4034-859e-b9e5c7ed444b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca16b975-6474-4c53-8bdd-575531ac866d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca16b975-6474-4c53-8bdd-575531ac866d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bb4987f-205f-4723-8e39-0247163d478a', 'volume_name': 'volume-4bb4987f-205f-4723-8e39-0247163d478a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe37093-15b1-455b-b81d-d6c7fa260fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe37093-15b1-455b-b81d-d6c7fa260fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fc618a-30a4-4d5b-9456-aaf4080a0955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:39 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Volume 4bb4987f-205f-4723-8e39-0247163d478a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bb4987f-205f-4723-8e39-0247163d478a', 'volume_size': 1} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9e094c49-6e07-42e6-924c-627326587707,created_at=2026-04-09T11:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-884959828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e094c49-6e07-42e6-924c-627326587707,host='devstack@QuobyteHD#QuobyteHD',id=4bb4987f-205f-4723-8e39-0247163d478a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3972b4519579450da4581e3420fa5883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:40Z,use_quota=True,user_id='69b1301c632945c8bf83296be10bbbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bab1b50e-c82c-45c3-998a-9558267e1e35),volume_type_id=bab1b50e-c82c-45c3-998a-9558267e1e35)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Creating volume 4bb4987f-205f-4723-8e39-0247163d478a {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:35:39 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:35:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:39 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a 1073741824 Apr 09 13:35:39 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:39 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12" returned: 0 in 0.429s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:40 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08" returned: 0 in 0.514s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-quobyte-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12" released by "delete_volume" :: held 1.045s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:40 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08 Apr 09 13:35:40 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Created reservations ['498ea68d-334e-491a-a417-22ddeb260a79', 'beaf0914-c933-4afd-bd3f-3ffc9ba5ad97', '28475ec8-8b7e-4927-8066-19e81b5d2542', '6d6eeda9-f51a-4ba7-a1f9-319d48dc4549'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:40 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:40 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:40 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a 1073741824" returned: 0 in 0.517s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:40 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a Apr 09 13:35:40 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:40 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cd02d124-e1d3-4d4d-8c82-8f526c2cde08" returned: 0 in 0.456s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Lock "cinder-quobyte-cd02d124-e1d3-4d4d-8c82-8f526c2cde08" released by "delete_volume" :: held 0.998s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Created reservations ['25dbfd6d-8dbf-40b6-a26d-fd1fd5fb3669', 'c1878cc3-95aa-4714-aaf1-8e9cddeb1ea9', 'fde91a78-724d-46f4-b83d-17931d611185', '6bc64546-6e29-425a-a158-049b6bf6e33e'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:40 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.457s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:40 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:40 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:40 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Deleted volume successfully. Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1509452-3dad-479d-bb82-5f22981afbe3 tempest-CreateVolumesFromSnapshotTest-1820614559 None] Lock "cinder-9d3191b7-f42a-4ff3-80b4-ab3e118c8e12-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:40 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a" returned: 0 in 0.479s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fc618a-30a4-4d5b-9456-aaf4080a0955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb4987f-205f-4723-8e39-0247163d478a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf65a1a-96f8-43ca-99eb-9d4dc83c894e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:40 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Volume volume-4bb4987f-205f-4723-8e39-0247163d478a (4bb4987f-205f-4723-8e39-0247163d478a): created successfully Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf65a1a-96f8-43ca-99eb-9d4dc83c894e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Flow 'volume_create_manager' (b43235a5-8c57-43fb-86b0-a09127d13477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:40 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-63237945-874d-4c7b-a19a-303126a00466 tempest-GroupSnapshotsV319Test-1665196533 None] Created volume successfully. Apr 09 13:35:40 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.413s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:41 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Deleted volume successfully. Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d4d39305-8c40-47aa-a7a1-79cebfbdca3a tempest-VolumesCloneTest-2009230866 None] Lock "cinder-cd02d124-e1d3-4d4d-8c82-8f526c2cde08-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Acquiring lock "cinder-2c7ae8b2-713c-4eef-abe1-49b940b0b803-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Lock "cinder-2c7ae8b2-713c-4eef-abe1-49b940b0b803-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Acquiring lock "cinder-quobyte-2c7ae8b2-713c-4eef-abe1-49b940b0b803" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Lock "cinder-quobyte-2c7ae8b2-713c-4eef-abe1-49b940b0b803" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[712a8152-4935-431a-a7b1-2512acfd5376]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:41 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 Apr 09 13:35:41 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:41 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] GroupSnapshot 3c4b2477-3659-46e1-8990-57d0c7e72c13: creating. Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] Group snapshot 3c4b2477-3659-46e1-8990-57d0c7e72c13: creating. {{(pid=82346) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] Creating offline snapshot a46d19d7-1dd0-4e0a-adee-919cf57e3208 of volume 4bb4987f-205f-4723-8e39-0247163d478a {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f94ab9b-ea83-4a53-8921-a2744781a803]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:42 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a Apr 09 13:35:42 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:42 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803" returned: 0 in 0.545s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:42 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803 Apr 09 13:35:42 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:42 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a" returned: 0 in 0.538s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:42 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 1G Apr 09 13:35:42 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:42 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2c7ae8b2-713c-4eef-abe1-49b940b0b803" returned: 0 in 0.500s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Lock "cinder-quobyte-2c7ae8b2-713c-4eef-abe1-49b940b0b803" released by "delete_volume" :: held 1.113s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Flow 'volume_create_manager' (77cc3938-ecd5-4071-b8e3-d9b327f7c521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9400d37-8d97-4a2e-9225-5b4fc48cf9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9400d37-8d97-4a2e-9225-5b4fc48cf9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-243479652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f762c5-4d63-4022-b84c-013f203065c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227be8a864f84a66903b12d9244f837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:43Z,use_quota=True,user_id='433aa19b3564470b86592da1af2a043a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f897b1-927b-4656-9aeb-351d79c7de8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f897b1-927b-4656-9aeb-351d79c7de8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da00416-3cad-4e70-974b-bbaceb21c71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da00416-3cad-4e70-974b-bbaceb21c71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f762c5-4d63-4022-b84c-013f203065c5', 'volume_name': 'volume-a1f762c5-4d63-4022-b84c-013f203065c5', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef25b1d-48c3-4dd5-9b0c-79759b5e3f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef25b1d-48c3-4dd5-9b0c-79759b5e3f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a403ea0-96f7-45fe-a798-59301a054861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:42 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Volume a1f762c5-4d63-4022-b84c-013f203065c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f762c5-4d63-4022-b84c-013f203065c5', 'volume_size': 1} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Created reservations ['68bd4937-3bbe-45ed-bcc1-236841287170', '79741d14-8ca2-4e68-bb54-1e47354aa556', 'd5d03f5b-7d6c-46ec-b514-2eb86c0f8606', '2343f502-3a23-405b-bf57-d2d103bf20b4'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:42 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:42 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:43 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 1G" returned: 0 in 0.554s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bb4987f-205f-4723-8e39-0247163d478a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:43 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bb4987f-205f-4723-8e39-0247163d478a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 Apr 09 13:35:43 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:43 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.482s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:43 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:43 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Deleted volume successfully. Apr 09 13:35:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fcce578d-a216-4abe-a2ce-26407925312a tempest-VolumesCloneTest-2009230866 None] Lock "cinder-2c7ae8b2-713c-4eef-abe1-49b940b0b803-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:43 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bb4987f-205f-4723-8e39-0247163d478a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208" returned: 0 in 0.432s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:43 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:35:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:43 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 Apr 09 13:35:43 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:43 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208" returned: 0 in 0.410s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:43 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.info Apr 09 13:35:43 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:44 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.info" returned: 0 in 0.474s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:44 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:44 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.info Apr 09 13:35:44 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:44 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.info" returned: 0 in 0.430s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.978s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-243479652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f762c5-4d63-4022-b84c-013f203065c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227be8a864f84a66903b12d9244f837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:43Z,use_quota=True,user_id='433aa19b3564470b86592da1af2a043a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Creating volume a1f762c5-4d63-4022-b84c-013f203065c5 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:35:44 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:35:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:44 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 1073741824 Apr 09 13:35:44 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:44 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-dbb2d4d0-6cbf-4d90-b3ce-48a16e2c197f tempest-GroupSnapshotsV319Test-1665196533 None] group_snapshot 3c4b2477-3659-46e1-8990-57d0c7e72c13: created successfully Apr 09 13:35:45 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] group_snapshot 3c4b2477-3659-46e1-8990-57d0c7e72c13: deleting Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] group_snapshot 3c4b2477-3659-46e1-8990-57d0c7e72c13: deleting {{(pid=82346) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Acquiring lock "cinder-quobyte-4bb4987f-205f-4723-8e39-0247163d478a" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Lock "cinder-quobyte-4bb4987f-205f-4723-8e39-0247163d478a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Acquiring lock "cinder-quobyte-a46d19d7-1dd0-4e0a-adee-919cf57e3208" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Lock "cinder-quobyte-a46d19d7-1dd0-4e0a-adee-919cf57e3208" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Deleting offline snapshot a46d19d7-1dd0-4e0a-adee-919cf57e3208 of volume 4bb4987f-205f-4723-8e39-0247163d478a {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] snapshot_file for this snap is: volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95c0378-c042-4b09-a99a-479e55bea811]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:45 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 1073741824" returned: 0 in 0.653s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:45 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 Apr 09 13:35:45 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:45 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 Apr 09 13:35:45 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:45 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208" returned: 0 in 0.526s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bb4987f-205f-4723-8e39-0247163d478a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:46 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab34594-b3aa-4eed-9e2b-a8b9f43593b8]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:46 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5" returned: 0 in 0.518s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:46 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:35:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:46 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a Apr 09 13:35:46 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a403ea0-96f7-45fe-a798-59301a054861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f762c5-4d63-4022-b84c-013f203065c5', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf354313-fed5-4b4b-ad0a-eb5edd491c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:46 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Volume volume-a1f762c5-4d63-4022-b84c-013f203065c5 (a1f762c5-4d63-4022-b84c-013f203065c5): created successfully Apr 09 13:35:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf354313-fed5-4b4b-ad0a-eb5edd491c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Flow 'volume_create_manager' (77cc3938-ecd5-4071-b8e3-d9b327f7c521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:46 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-edbf2cd3-27cb-4aae-b2cf-67232caf8a4d tempest-VolumeDependencyTests-576062913 None] Created volume successfully. Apr 09 13:35:46 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a" returned: 0 in 0.508s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:46 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 Apr 09 13:35:46 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:47 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208" returned: 0 in 0.527s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:47 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208 Apr 09 13:35:47 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] Creating offline snapshot 30363323-561c-4ebb-b6ce-125b72b2fe2d of volume a1f762c5-4d63-4022-b84c-013f203065c5 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[503abe41-c6c4-428d-9838-1b430911f1fc]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:47 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 Apr 09 13:35:47 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:47 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a.a46d19d7-1dd0-4e0a-adee-919cf57e3208" returned: 0 in 0.491s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Lock "cinder-quobyte-a46d19d7-1dd0-4e0a-adee-919cf57e3208" released by "_delete_snapshot" :: held 2.119s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Lock "cinder-quobyte-4bb4987f-205f-4723-8e39-0247163d478a" released by "delete_snapshot" :: held 2.132s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:47 devstack cinder-volume[82346]: WARNING cinder.quota [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-448328264 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-448328264, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:35:47 devstack cinder-volume[82346]: WARNING cinder.quota [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-448328264 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-448328264, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] Created reservations ['86160554-848b-4d81-8063-044ab02aae24', 'f543b6a4-1edb-4d4d-a82f-5e7ab0926084', '28921eda-3632-4556-84f7-7d0c7de09e52', 'c116acf4-e46f-4f70-a88f-f5ef6251be20'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:47 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b9070283-abcc-489f-9da0-3fafb81f6662 tempest-GroupSnapshotsV319Test-1665196533 None] group_snapshot 3c4b2477-3659-46e1-8990-57d0c7e72c13: deleted successfully Apr 09 13:35:47 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5" returned: 0 in 0.546s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:47 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d 1G Apr 09 13:35:47 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:48 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d 1G" returned: 0 in 0.518s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f762c5-4d63-4022-b84c-013f203065c5 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:48 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f762c5-4d63-4022-b84c-013f203065c5 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d Apr 09 13:35:48 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Acquiring lock "cinder-quobyte-4bb4987f-205f-4723-8e39-0247163d478a" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:48 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1f762c5-4d63-4022-b84c-013f203065c5 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d" returned: 0 in 0.531s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:48 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d is being set with open permissions: ugo+rw Apr 09 13:35:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Lock "cinder-quobyte-4bb4987f-205f-4723-8e39-0247163d478a" acquired by "delete_volume" :: waited 0.032s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:48 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d Apr 09 13:35:48 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:48 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d3b4f4-c10d-4077-bf69-26a554dc7b72]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:48 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a Apr 09 13:35:48 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:49 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d" returned: 0 in 0.461s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:49 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.info Apr 09 13:35:49 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:49 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a" returned: 0 in 0.646s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:49 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a Apr 09 13:35:49 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:49 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.info" returned: 0 in 0.527s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:49 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.info is being set with open permissions: ugo+rw Apr 09 13:35:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:49 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.info Apr 09 13:35:49 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:50 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4bb4987f-205f-4723-8e39-0247163d478a" returned: 0 in 0.557s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Lock "cinder-quobyte-4bb4987f-205f-4723-8e39-0247163d478a" released by "delete_volume" :: held 1.245s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Created reservations ['f9e2992c-4692-4a9d-9c49-3349f1662754'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:50 devstack cinder-volume[82346]: WARNING cinder.quota [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-448328264 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-448328264, it is now deprecated. Please use the default quota class for default quota. Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Created reservations ['0797616f-ebda-4ad4-b0cd-0d5484885925', '00392133-b6a3-44ab-b464-4de5a0b6b07e', '2bebb34e-f219-4b7e-acf3-ceb236f77445', '3febdb48-6f65-463e-a9d3-a5540613a1d6'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:50 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:35:50 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:50 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.info" returned: 0 in 0.543s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.201s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:50 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-61d3cc01-330c-45e3-87c1-3c33cdd552ac tempest-VolumeDependencyTests-576062913 None] Create snapshot completed successfully Apr 09 13:35:50 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.511s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:50 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:35:50 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3a807039-7b53-4440-89fd-ef9467b07a5d tempest-GroupSnapshotsV319Test-1665196533 None] Delete group completed successfully. Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Flow 'volume_create_manager' (d21b0573-76a8-4533-af74-21a0464207f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41b0da2-f45f-4a33-9ed3-99bf80f2b34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41b0da2-f45f-4a33-9ed3-99bf80f2b34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1326223413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44b84b4-16a2-4bca-83d2-2d18a067863d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227be8a864f84a66903b12d9244f837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=30363323-561c-4ebb-b6ce-125b72b2fe2d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:35:52Z,use_quota=True,user_id='433aa19b3564470b86592da1af2a043a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1313d96a-5315-4e3e-bf9a-abeb1253413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1313d96a-5315-4e3e-bf9a-abeb1253413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6f43e6-79ad-4c7c-9053-d08e303428fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6f43e6-79ad-4c7c-9053-d08e303428fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd44b84b4-16a2-4bca-83d2-2d18a067863d', 'volume_name': 'volume-d44b84b4-16a2-4bca-83d2-2d18a067863d', 'volume_size': 1, 'snapshot_id': '30363323-561c-4ebb-b6ce-125b72b2fe2d'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eabd1d7-27b1-4584-ad97-8a4bcfd0eabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eabd1d7-27b1-4584-ad97-8a4bcfd0eabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2208a6a3-937e-43c0-b145-a726a2310fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:51 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Volume d44b84b4-16a2-4bca-83d2-2d18a067863d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d44b84b4-16a2-4bca-83d2-2d18a067863d', 'volume_size': 1, 'snapshot_id': '30363323-561c-4ebb-b6ce-125b72b2fe2d'} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-quobyte-30363323-561c-4ebb-b6ce-125b72b2fe2d-d44b84b4-16a2-4bca-83d2-2d18a067863d" by "_create_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-30363323-561c-4ebb-b6ce-125b72b2fe2d-d44b84b4-16a2-4bca-83d2-2d18a067863d" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Creating volume d44b84b4-16a2-4bca-83d2-2d18a067863d from snapshot 30363323-561c-4ebb-b6ce-125b72b2fe2d {{(pid=82346) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-quobyte-d44b84b4-16a2-4bca-83d2-2d18a067863d" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-d44b84b4-16a2-4bca-83d2-2d18a067863d" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] snapshot: 30363323-561c-4ebb-b6ce-125b72b2fe2d, volume: d44b84b4-16a2-4bca-83d2-2d18a067863d, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[df08c5d2-4b8d-46d1-b90f-c0207a907b6c]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:51 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d Apr 09 13:35:51 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:52 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d" returned: 0 in 0.591s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1f762c5-4d63-4022-b84c-013f203065c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:35:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:35:52 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[57db8ec1-f380-4f5c-917d-5d3f8be7e78b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:52 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 Apr 09 13:35:52 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:53 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5" returned: 0 in 0.684s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:53 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:35:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:53 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d Apr 09 13:35:53 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:55 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d" returned: 0 in 2.506s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:55 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4cfe57-89b4-431a-a3a6-a18512b1f6ba]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:55 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 Apr 09 13:35:55 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:56 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5" returned: 0 in 0.696s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:56 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:35:56 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Converted 1024.00 MB image at 408.36 MB/s Apr 09 13:35:56 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d is being set with open permissions: ugo+rw Apr 09 13:35:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:56 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d Apr 09 13:35:56 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:56 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d" returned: 0 in 0.464s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:56 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-d44b84b4-16a2-4bca-83d2-2d18a067863d" released by "_copy_volume_from_snapshot" :: held 5.006s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:56 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-30363323-561c-4ebb-b6ce-125b72b2fe2d-d44b84b4-16a2-4bca-83d2-2d18a067863d" released by "_create_volume_from_snapshot" :: held 5.022s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.031s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:35:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2208a6a3-937e-43c0-b145-a726a2310fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d44b84b4-16a2-4bca-83d2-2d18a067863d', 'volume_size': 1, 'snapshot_id': '30363323-561c-4ebb-b6ce-125b72b2fe2d'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71220fa-8a9b-4b1a-9f99-f00ce0525e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:35:56 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Volume volume-d44b84b4-16a2-4bca-83d2-2d18a067863d (d44b84b4-16a2-4bca-83d2-2d18a067863d): created successfully Apr 09 13:35:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71220fa-8a9b-4b1a-9f99-f00ce0525e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:35:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Flow 'volume_create_manager' (d21b0573-76a8-4533-af74-21a0464207f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:35:56 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-44b21a8e-9774-4d3a-8c9f-8952cb383375 tempest-VolumeDependencyTests-576062913 None] Created volume successfully. Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-30363323-561c-4ebb-b6ce-125b72b2fe2d-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-30363323-561c-4ebb-b6ce-125b72b2fe2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-quobyte-a1f762c5-4d63-4022-b84c-013f203065c5" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-a1f762c5-4d63-4022-b84c-013f203065c5" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-quobyte-30363323-561c-4ebb-b6ce-125b72b2fe2d" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-30363323-561c-4ebb-b6ce-125b72b2fe2d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Deleting offline snapshot 30363323-561c-4ebb-b6ce-125b72b2fe2d of volume a1f762c5-4d63-4022-b84c-013f203065c5 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] snapshot_file for this snap is: volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c386f2-9071-4f92-a07c-745da89ee8fd]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:57 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d Apr 09 13:35:57 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:57 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d" returned: 0 in 0.624s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1f762c5-4d63-4022-b84c-013f203065c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[292290c5-92d2-41e9-8445-82695039fea9]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:35:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:57 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 Apr 09 13:35:57 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:58 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5" returned: 0 in 0.547s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:58 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d Apr 09 13:35:58 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:58 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d" returned: 0 in 0.489s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:35:58 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d Apr 09 13:35:58 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:35:59 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 09 13:35:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5.30363323-561c-4ebb-b6ce-125b72b2fe2d" returned: 0 in 0.522s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:35:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-30363323-561c-4ebb-b6ce-125b72b2fe2d" released by "_delete_snapshot" :: held 2.249s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-a1f762c5-4d63-4022-b84c-013f203065c5" released by "delete_snapshot" :: held 2.272s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:35:59 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Created reservations ['8f84d5ac-0f78-4031-a962-374e472c88e5', '4e1b7a49-d415-4e3f-8574-06cfff68224f', 'd1438aac-be27-4294-b1dd-3fcfc613296c', '93eaf870-9c9d-45e4-841b-1a667d29ec69'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:35:59 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Delete snapshot completed successfully. Apr 09 13:35:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0cf021f9-abd5-40fb-a764-8b29e5dae187 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-30363323-561c-4ebb-b6ce-125b72b2fe2d-delete_snapshot" released by "delete_snapshot" :: held 2.373s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-a1f762c5-4d63-4022-b84c-013f203065c5-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-a1f762c5-4d63-4022-b84c-013f203065c5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-quobyte-a1f762c5-4d63-4022-b84c-013f203065c5" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-a1f762c5-4d63-4022-b84c-013f203065c5" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb6f953-c9c1-4708-b302-e90423767bbe]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:00 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 Apr 09 13:36:00 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Flow 'volume_create_manager' (6a577c0a-a2ae-48f7-b1d5-e5729a5f1279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d765d06-7988-4b76-888b-3c8edd2e3cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d765d06-7988-4b76-888b-3c8edd2e3cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-359047238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b806ee20-f0e1-4650-b77f-2bc99ce69797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cd00c26a024f15bc483b115c49e46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:01Z,use_quota=True,user_id='cee1cd41d25a46c59b0bbf09a0bdf9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db922e4-d8a5-4ba7-8a75-1f44900ca788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db922e4-d8a5-4ba7-8a75-1f44900ca788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6658b9c9-d0cd-4db8-afb1-8e489052c4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6658b9c9-d0cd-4db8-afb1-8e489052c4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b806ee20-f0e1-4650-b77f-2bc99ce69797', 'volume_name': 'volume-b806ee20-f0e1-4650-b77f-2bc99ce69797', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e88f69f-75c8-4d1e-9334-52d896518982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e88f69f-75c8-4d1e-9334-52d896518982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4ca5dc-381a-4ee3-ab06-5038cbab570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:00 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Volume b806ee20-f0e1-4650-b77f-2bc99ce69797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b806ee20-f0e1-4650-b77f-2bc99ce69797', 'volume_size': 1} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-359047238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b806ee20-f0e1-4650-b77f-2bc99ce69797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cd00c26a024f15bc483b115c49e46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:01Z,use_quota=True,user_id='cee1cd41d25a46c59b0bbf09a0bdf9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Creating volume b806ee20-f0e1-4650-b77f-2bc99ce69797 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:36:00 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:00 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797 1073741824 Apr 09 13:36:00 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:00 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5" returned: 0 in 0.615s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:00 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5 Apr 09 13:36:00 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:01 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797 1073741824" returned: 0 in 0.499s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:01 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797 Apr 09 13:36:01 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:01 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a1f762c5-4d63-4022-b84c-013f203065c5" returned: 0 in 0.499s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-a1f762c5-4d63-4022-b84c-013f203065c5" released by "delete_volume" :: held 1.161s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Created reservations ['f53e3b1f-6c20-4ab8-a3a0-1c732516b60d', '703e9468-59ee-4bd8-b690-70855c1d48be', '004a487f-c110-445f-a0c5-19c16d82e9f6', 'ba5075ba-3c77-40d4-8bf2-dde0be7e6546'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:01 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:01 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:01 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797" returned: 0 in 0.503s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4ca5dc-381a-4ee3-ab06-5038cbab570c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b806ee20-f0e1-4650-b77f-2bc99ce69797', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d29906-bd21-4df8-aeba-a4b1e062db12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:01 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Volume volume-b806ee20-f0e1-4650-b77f-2bc99ce69797 (b806ee20-f0e1-4650-b77f-2bc99ce69797): created successfully Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d29906-bd21-4df8-aeba-a4b1e062db12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Flow 'volume_create_manager' (6a577c0a-a2ae-48f7-b1d5-e5729a5f1279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:01 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2d635ac3-658c-46fc-8259-0a7222303c49 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Created volume successfully. Apr 09 13:36:02 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.499s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:02 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Deleted volume successfully. Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c735065f-1ce0-43cd-87b7-b5789c6da467 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-a1f762c5-4d63-4022-b84c-013f203065c5-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Flow 'volume_create_manager' (2bef9c63-d02c-43f6-97ff-959e3533b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70170ae2-673d-4356-b61d-b233789a891f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70170ae2-673d-4356-b61d-b233789a891f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-528580488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1aad529-834a-4cb6-8dda-d9795d3805a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227be8a864f84a66903b12d9244f837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:03Z,use_quota=True,user_id='433aa19b3564470b86592da1af2a043a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881db9f0-8a5e-41ba-b761-5ecda98abdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881db9f0-8a5e-41ba-b761-5ecda98abdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a9039b-7d09-4f3d-91a2-1ddfcc9fe9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a9039b-7d09-4f3d-91a2-1ddfcc9fe9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1aad529-834a-4cb6-8dda-d9795d3805a5', 'volume_name': 'volume-e1aad529-834a-4cb6-8dda-d9795d3805a5', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68c2e58-db80-48ed-8726-29db61be78fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68c2e58-db80-48ed-8726-29db61be78fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c0e8551-f9ec-4b4d-ac0c-b191dc72d962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:02 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Volume e1aad529-834a-4cb6-8dda-d9795d3805a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1aad529-834a-4cb6-8dda-d9795d3805a5', 'volume_size': 1} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-528580488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1aad529-834a-4cb6-8dda-d9795d3805a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227be8a864f84a66903b12d9244f837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:03Z,use_quota=True,user_id='433aa19b3564470b86592da1af2a043a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Creating volume e1aad529-834a-4cb6-8dda-d9795d3805a5 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:36:02 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:02 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 1073741824 Apr 09 13:36:02 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Acquiring lock "cinder-b806ee20-f0e1-4650-b77f-2bc99ce69797-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "cinder-b806ee20-f0e1-4650-b77f-2bc99ce69797-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Acquiring lock "cinder-quobyte-b806ee20-f0e1-4650-b77f-2bc99ce69797" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "cinder-quobyte-b806ee20-f0e1-4650-b77f-2bc99ce69797" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f23719-b5d5-4c9a-97f2-8665d6d735b8]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Flow 'volume_create_manager' (fe0273d2-9ff1-4b89-b277-ad27a7e30257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9acb54-62d4-4fd3-ba32-c545bbc858c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9acb54-62d4-4fd3-ba32-c545bbc858c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-530582805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6894cfae-ac16-40f7-aa1f-ec6bb02fa723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9465c2c17e048ca9f65596541563c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:03Z,use_quota=True,user_id='4f13aa86dbd14c25ac9d243fd67a5e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48faae2-9077-4010-8646-e5fcea445f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48faae2-9077-4010-8646-e5fcea445f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:03 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797 Apr 09 13:36:03 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f9fd54-7340-44a6-a6a8-9e134e32d116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f9fd54-7340-44a6-a6a8-9e134e32d116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6894cfae-ac16-40f7-aa1f-ec6bb02fa723', 'volume_name': 'volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1cd65d-03a2-4047-87c3-fab00018f719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1cd65d-03a2-4047-87c3-fab00018f719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf3648f-6400-45a3-8284-a4f684e83cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:03 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Volume 6894cfae-ac16-40f7-aa1f-ec6bb02fa723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723', 'volume_size': 1} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:03 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 1073741824" returned: 0 in 0.557s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:03 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 Apr 09 13:36:03 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:03 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797" returned: 0 in 0.541s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:03 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797 Apr 09 13:36:03 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:03 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5" returned: 0 in 0.431s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.622s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-530582805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6894cfae-ac16-40f7-aa1f-ec6bb02fa723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9465c2c17e048ca9f65596541563c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:03Z,use_quota=True,user_id='4f13aa86dbd14c25ac9d243fd67a5e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Creating volume 6894cfae-ac16-40f7-aa1f-ec6bb02fa723 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:36:03 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c0e8551-f9ec-4b4d-ac0c-b191dc72d962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1aad529-834a-4cb6-8dda-d9795d3805a5', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3f2c6b-6057-48c9-acd7-e7e16dc9acad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:03 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 1073741824 Apr 09 13:36:03 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:03 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Volume volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 (e1aad529-834a-4cb6-8dda-d9795d3805a5): created successfully Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3f2c6b-6057-48c9-acd7-e7e16dc9acad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Flow 'volume_create_manager' (2bef9c63-d02c-43f6-97ff-959e3533b96b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:03 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2d772d37-c20b-48bf-9435-8ee2374368c4 tempest-VolumeDependencyTests-576062913 None] Created volume successfully. Apr 09 13:36:03 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b806ee20-f0e1-4650-b77f-2bc99ce69797" returned: 0 in 0.429s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "cinder-quobyte-b806ee20-f0e1-4650-b77f-2bc99ce69797" released by "delete_volume" :: held 0.995s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Created reservations ['e1c671f0-5562-427b-8c48-b8956bbab02c', 'b0b84bdd-00cb-412f-9e6d-d362b53c0eda', '98c751c1-e8f5-44e7-a288-8be4e6e4d95f', 'fd076652-64e1-4d50-a855-56f61ab36293'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:04 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:04 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:04 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 1073741824" returned: 0 in 0.481s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:04 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 Apr 09 13:36:04 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:04 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.424s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:04 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Deleted volume successfully. Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-430cdfe1-032c-4da5-8526-10a1b9195d6d tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "cinder-b806ee20-f0e1-4650-b77f-2bc99ce69797-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:04 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" returned: 0 in 0.437s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf3648f-6400-45a3-8284-a4f684e83cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8a4829-5f56-49e1-aec0-74849ea6effd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:04 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Volume volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 (6894cfae-ac16-40f7-aa1f-ec6bb02fa723): created successfully Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a8a4829-5f56-49e1-aec0-74849ea6effd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:04 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Flow 'volume_create_manager' (fe0273d2-9ff1-4b89-b277-ad27a7e30257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:04 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-0eddf42e-c8a9-40f8-ae55-28737b0eb554 tempest-SnapshotDependencyTests-165415979 None] Created volume successfully. Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Flow 'volume_create_manager' (90b806e9-6178-4523-b728-331d30580e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c88e4c9-6276-4671-b5ed-a3cde9fde004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c88e4c9-6276-4671-b5ed-a3cde9fde004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-200193506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917049f6-8c30-4769-930c-9a86bdc8e7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227be8a864f84a66903b12d9244f837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e1aad529-834a-4cb6-8dda-d9795d3805a5,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:05Z,use_quota=True,user_id='433aa19b3564470b86592da1af2a043a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177fd9a7-e981-4058-ac72-d5a316a9d030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177fd9a7-e981-4058-ac72-d5a316a9d030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66187d4b-5c90-445a-8ecd-07f90b37dce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66187d4b-5c90-445a-8ecd-07f90b37dce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '917049f6-8c30-4769-930c-9a86bdc8e7b7', 'volume_name': 'volume-917049f6-8c30-4769-930c-9a86bdc8e7b7', 'volume_size': 1, 'source_volid': 'e1aad529-834a-4cb6-8dda-d9795d3805a5', 'source_volstatus': 'available'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a549c012-25c9-49f1-a421-811e87b4458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a549c012-25c9-49f1-a421-811e87b4458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd64d083-9c56-4333-8118-3ac764a88276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:05 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Volume 917049f6-8c30-4769-930c-9a86bdc8e7b7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-917049f6-8c30-4769-930c-9a86bdc8e7b7', 'volume_size': 1, 'source_volid': 'e1aad529-834a-4cb6-8dda-d9795d3805a5', 'source_volstatus': 'available'} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:05 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Cloning volume e1aad529-834a-4cb6-8dda-d9795d3805a5 to volume 917049f6-8c30-4769-930c-9a86bdc8e7b7 Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Creating offline snapshot c74e98c0-4387-4601-969f-07b241f8f433 of volume e1aad529-834a-4cb6-8dda-d9795d3805a5 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04057fa-d8a3-4d76-93b5-a5ce367cd5d9]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:05 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 Apr 09 13:36:05 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Flow 'volume_create_manager' (37ae29fa-a57d-4cbb-94f5-a992daa1204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf26f03-7b91-438f-bb4d-0887b06709d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf26f03-7b91-438f-bb4d-0887b06709d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-427011527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c00b2a-6ff2-401a-b00a-5bd11232aa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cd00c26a024f15bc483b115c49e46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:05Z,use_quota=True,user_id='cee1cd41d25a46c59b0bbf09a0bdf9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951032b2-60da-4262-bf94-cce4cc7835f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951032b2-60da-4262-bf94-cce4cc7835f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a41506-939b-49e8-82b8-52096f5e2a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a41506-939b-49e8-82b8-52096f5e2a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c00b2a-6ff2-401a-b00a-5bd11232aa89', 'volume_name': 'volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e091a195-7305-4bc8-a6d4-073d73a9f7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e091a195-7305-4bc8-a6d4-073d73a9f7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f0d4bf-17ee-43a3-a429-986b953a9fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:05 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Volume 60c00b2a-6ff2-401a-b00a-5bd11232aa89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89', 'volume_size': 1} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:05 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5" returned: 0 in 0.526s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:05 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 1G Apr 09 13:36:05 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:06 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 1G" returned: 0 in 0.480s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:06 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 Apr 09 13:36:06 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:06 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433" returned: 0 in 0.440s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:06 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 is being set with open permissions: ugo+rw Apr 09 13:36:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:06 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 Apr 09 13:36:06 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:06 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433" returned: 0 in 0.389s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:07 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.info Apr 09 13:36:07 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:07 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.info" returned: 0 in 0.433s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:07 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.info is being set with open permissions: ugo+rw Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:07 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.info Apr 09 13:36:07 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:07 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.info" returned: 0 in 0.387s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-quobyte-917049f6-8c30-4769-930c-9a86bdc8e7b7" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-917049f6-8c30-4769-930c-9a86bdc8e7b7" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] snapshot: c74e98c0-4387-4601-969f-07b241f8f433, volume: 917049f6-8c30-4769-930c-9a86bdc8e7b7, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2d505d-c7a4-4e69-82c0-23ad1a067785]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:07 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 Apr 09 13:36:07 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:08 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433" returned: 0 in 0.467s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1aad529-834a-4cb6-8dda-d9795d3805a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:36:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:36:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:36:08 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e849d8-37e7-4ea6-869b-0d6099a3f10a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:08 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 Apr 09 13:36:08 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:08 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5" returned: 0 in 0.458s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:08 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:36:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:08 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 Apr 09 13:36:08 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:10 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7" returned: 0 in 1.907s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:10 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe826fd-9a69-4ff4-b7a8-41d66bd6a70b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:10 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 Apr 09 13:36:10 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:11 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5" returned: 0 in 0.578s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:11 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:36:11 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Converted 1024.00 MB image at 536.59 MB/s Apr 09 13:36:11 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 is being set with open permissions: ugo+rw Apr 09 13:36:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:11 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 Apr 09 13:36:11 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:11 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7" returned: 0 in 0.431s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-917049f6-8c30-4769-930c-9a86bdc8e7b7" released by "_copy_volume_from_snapshot" :: held 3.887s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-quobyte-c74e98c0-4387-4601-969f-07b241f8f433" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-c74e98c0-4387-4601-969f-07b241f8f433" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Deleting offline snapshot c74e98c0-4387-4601-969f-07b241f8f433 of volume e1aad529-834a-4cb6-8dda-d9795d3805a5 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:36:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] snapshot_file for this snap is: volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:36:11 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f94569-1b57-4d83-9b59-4b23702a2134]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:11 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 Apr 09 13:36:11 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:12 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433" returned: 0 in 0.503s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1aad529-834a-4cb6-8dda-d9795d3805a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:36:12 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7fdd51-d24b-4ed0-bb7a-91a7b21226e4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:12 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 Apr 09 13:36:12 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:12 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5" returned: 0 in 0.469s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:12 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 Apr 09 13:36:12 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:13 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433" returned: 0 in 0.442s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:13 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433 Apr 09 13:36:13 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:13 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5.c74e98c0-4387-4601-969f-07b241f8f433" returned: 0 in 0.400s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-c74e98c0-4387-4601-969f-07b241f8f433" released by "_delete_snapshot" :: held 1.861s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.526s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.202s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd64d083-9c56-4333-8118-3ac764a88276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917049f6-8c30-4769-930c-9a86bdc8e7b7', 'volume_size': 1, 'source_volid': 'e1aad529-834a-4cb6-8dda-d9795d3805a5', 'source_volstatus': 'available'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24e78ce-e41f-490f-a848-ae0dad0e2ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] Creating offline snapshot 40860766-40d6-4f5b-a3a7-27ed827969c5 of volume 6894cfae-ac16-40f7-aa1f-ec6bb02fa723 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:36:13 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Volume volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 (917049f6-8c30-4769-930c-9a86bdc8e7b7): created successfully Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24e78ce-e41f-490f-a848-ae0dad0e2ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Flow 'volume_create_manager' (90b806e9-6178-4523-b728-331d30580e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5ca755-a98d-472f-adcb-1c8faa35b447]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:13 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-4f145abd-0041-483b-8b11-85a8d6530589 tempest-VolumeDependencyTests-576062913 None] Created volume successfully. Apr 09 13:36:13 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 Apr 09 13:36:13 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:14 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" returned: 0 in 0.461s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:14 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 1G Apr 09 13:36:14 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-e1aad529-834a-4cb6-8dda-d9795d3805a5-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Lock "cinder-e1aad529-834a-4cb6-8dda-d9795d3805a5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-quobyte-e1aad529-834a-4cb6-8dda-d9795d3805a5" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-e1aad529-834a-4cb6-8dda-d9795d3805a5" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:14 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f6ab61-39c2-4bf7-a584-e564c7f17e25]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:14 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 Apr 09 13:36:14 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:14 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 1G" returned: 0 in 0.538s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:14 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 Apr 09 13:36:14 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:15 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5" returned: 0 in 0.473s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:15 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5 Apr 09 13:36:15 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:15 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5" returned: 0 in 0.449s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:15 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 is being set with open permissions: ugo+rw Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:15 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 Apr 09 13:36:15 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:15 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e1aad529-834a-4cb6-8dda-d9795d3805a5" returned: 0 in 0.399s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-e1aad529-834a-4cb6-8dda-d9795d3805a5" released by "delete_volume" :: held 0.903s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Created reservations ['e844af2b-bd68-4108-a86d-2830b3574d94', '0e9902b3-b8e0-4db0-9d7c-09e395890a76', 'e6576efa-5ba4-40f4-990c-504fa0acad4d', 'ee299192-299c-4fde-8cd3-c25c414d2bb3'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:15 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5" returned: 0 in 0.399s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:15 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.info Apr 09 13:36:15 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:15 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:15 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-917049f6-8c30-4769-930c-9a86bdc8e7b7-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-917049f6-8c30-4769-930c-9a86bdc8e7b7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-quobyte-917049f6-8c30-4769-930c-9a86bdc8e7b7" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-917049f6-8c30-4769-930c-9a86bdc8e7b7" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dfd2df-8f47-4872-be16-26637ffbc442]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:15 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 Apr 09 13:36:15 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:16 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.info" returned: 0 in 0.459s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:16 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.info is being set with open permissions: ugo+rw Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:16 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.447s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:16 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.info Apr 09 13:36:16 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:16 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Deleted volume successfully. Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f0df7b6f-2229-4c7a-baf4-fd6ae11dd10d tempest-VolumeDependencyTests-576062913 None] Lock "cinder-e1aad529-834a-4cb6-8dda-d9795d3805a5-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:16 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7" returned: 0 in 0.524s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:16 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7 Apr 09 13:36:16 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:16 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.info" returned: 0 in 0.417s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.811s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.977s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-427011527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c00b2a-6ff2-401a-b00a-5bd11232aa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22cd00c26a024f15bc483b115c49e46f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:05Z,use_quota=True,user_id='cee1cd41d25a46c59b0bbf09a0bdf9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Creating volume 60c00b2a-6ff2-401a-b00a-5bd11232aa89 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:36:16 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:16 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89 1073741824 Apr 09 13:36:16 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:16 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-a2fc0842-410f-45f3-bdd4-f4efe2829300 tempest-SnapshotDependencyTests-165415979 None] Create snapshot completed successfully Apr 09 13:36:16 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-917049f6-8c30-4769-930c-9a86bdc8e7b7" returned: 0 in 0.430s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-917049f6-8c30-4769-930c-9a86bdc8e7b7" released by "delete_volume" :: held 0.978s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Created reservations ['95850e7e-2a2f-4e36-97cd-38cc358d8515', 'c183b61a-6b44-47ed-9173-ea2d20806c39', '9481ccf9-5114-496f-bbdd-a043909d9db2', '0aeb28d1-7285-4cc9-986b-00da8f3f316f'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:16 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:16 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:17 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89 1073741824" returned: 0 in 0.546s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:17 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89 Apr 09 13:36:17 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Flow 'volume_create_manager' (e972504f-8c6f-4197-a1b3-acf626f1f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ee920f-e4f0-4deb-bbca-9d481acca792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ee920f-e4f0-4deb-bbca-9d481acca792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95549906-45d6-4304-aae8-d8f884b4ec22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9465c2c17e048ca9f65596541563c40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=40860766-40d6-4f5b-a3a7-27ed827969c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:17Z,use_quota=True,user_id='4f13aa86dbd14c25ac9d243fd67a5e7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02404df-17aa-4a7a-bf2f-21fc3b0d7112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02404df-17aa-4a7a-bf2f-21fc3b0d7112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830a100c-8eef-41fe-86ec-b5ad130b4753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830a100c-8eef-41fe-86ec-b5ad130b4753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '95549906-45d6-4304-aae8-d8f884b4ec22', 'volume_name': 'volume-95549906-45d6-4304-aae8-d8f884b4ec22', 'volume_size': 1, 'snapshot_id': '40860766-40d6-4f5b-a3a7-27ed827969c5'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f0571-1908-4b56-a44e-5ef586909ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f0571-1908-4b56-a44e-5ef586909ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6317d93-7a30-408e-96af-189fbc2f2de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:17 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Volume 95549906-45d6-4304-aae8-d8f884b4ec22: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-95549906-45d6-4304-aae8-d8f884b4ec22', 'volume_size': 1, 'snapshot_id': '40860766-40d6-4f5b-a3a7-27ed827969c5'} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:17 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.462s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:17 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Deleted volume successfully. Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f439e117-cb13-46d3-8464-f9cf7cfc81c8 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-917049f6-8c30-4769-930c-9a86bdc8e7b7-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:17 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89" returned: 0 in 0.427s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.277s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "cinder-quobyte-40860766-40d6-4f5b-a3a7-27ed827969c5-95549906-45d6-4304-aae8-d8f884b4ec22" by "_create_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f0d4bf-17ee-43a3-a429-986b953a9fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c261903-9cc0-4a80-bf7c-2b346902350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-40860766-40d6-4f5b-a3a7-27ed827969c5-95549906-45d6-4304-aae8-d8f884b4ec22" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Creating volume 95549906-45d6-4304-aae8-d8f884b4ec22 from snapshot 40860766-40d6-4f5b-a3a7-27ed827969c5 {{(pid=82346) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "cinder-quobyte-95549906-45d6-4304-aae8-d8f884b4ec22" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:17 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Volume volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89 (60c00b2a-6ff2-401a-b00a-5bd11232aa89): created successfully Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c261903-9cc0-4a80-bf7c-2b346902350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Flow 'volume_create_manager' (37ae29fa-a57d-4cbb-94f5-a992daa1204e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:17 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f3e6040a-d5fe-4370-abc5-3b6a71aecea7 tempest-VolumeQuotasAdminTestJSON-1896445654 None] Created volume successfully. Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-95549906-45d6-4304-aae8-d8f884b4ec22" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] snapshot: 40860766-40d6-4f5b-a3a7-27ed827969c5, volume: 95549906-45d6-4304-aae8-d8f884b4ec22, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[32370915-2cb8-46d0-9377-6e0f45428dcc]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:17 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 Apr 09 13:36:17 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-d44b84b4-16a2-4bca-83d2-2d18a067863d-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-d44b84b4-16a2-4bca-83d2-2d18a067863d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "cinder-quobyte-d44b84b4-16a2-4bca-83d2-2d18a067863d" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-d44b84b4-16a2-4bca-83d2-2d18a067863d" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbe461f-1445-4867-97b1-6a03f0757ea3]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:18 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d Apr 09 13:36:18 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:18 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5" returned: 0 in 0.497s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[22455a70-b037-42f0-a3e4-ada3f184847d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:18 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 Apr 09 13:36:18 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:18 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-9e342478-7c04-4ca4-a896-8ac44f6faf1e tempest-VolumeQuotasAdminTestJSON-1828909978 None] Transfer volume completed successfully. Apr 09 13:36:18 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d" returned: 0 in 0.545s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:18 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d Apr 09 13:36:18 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:18 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" returned: 0 in 0.477s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:18 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22 Apr 09 13:36:18 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:18 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d44b84b4-16a2-4bca-83d2-2d18a067863d" returned: 0 in 0.456s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-quobyte-d44b84b4-16a2-4bca-83d2-2d18a067863d" released by "delete_volume" :: held 1.028s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:19 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Created reservations ['e4e2310c-122e-49cc-9093-9855db5034cc', 'e6ac9cfe-59fe-4e8b-9b45-5cd22d718547', 'ea557778-746e-44c2-a34d-0ba961e0ca7a', '87a6f741-8309-4928-8e3b-398c6a3b6de8'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:19 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:19 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Acquiring lock "cinder-60c00b2a-6ff2-401a-b00a-5bd11232aa89-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Lock "cinder-60c00b2a-6ff2-401a-b00a-5bd11232aa89-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Acquiring lock "cinder-quobyte-60c00b2a-6ff2-401a-b00a-5bd11232aa89" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Lock "cinder-quobyte-60c00b2a-6ff2-401a-b00a-5bd11232aa89" acquired by "delete_volume" :: waited 0.045s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e5c6c1-fe1d-4c7b-a589-607d451ee1d2]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:20 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 1.356s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:20 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Deleted volume successfully. Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-35518b86-8b44-4e4d-b20a-ee7a863e41f2 tempest-VolumeDependencyTests-576062913 None] Lock "cinder-d44b84b4-16a2-4bca-83d2-2d18a067863d-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:20 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89 Apr 09 13:36:20 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:20 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22" returned: 0 in 2.160s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce6ecb9-8107-439d-aa0f-d5f250be7c13]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:20 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 Apr 09 13:36:20 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:21 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89" returned: 0 in 0.626s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:21 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89 Apr 09 13:36:21 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:21 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" returned: 0 in 0.687s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:36:21 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Converted 1024.00 MB image at 473.94 MB/s Apr 09 13:36:21 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22 is being set with open permissions: ugo+rw Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:21 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22 Apr 09 13:36:21 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:21 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-60c00b2a-6ff2-401a-b00a-5bd11232aa89" returned: 0 in 0.508s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Lock "cinder-quobyte-60c00b2a-6ff2-401a-b00a-5bd11232aa89" released by "delete_volume" :: held 1.186s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Created reservations ['61e4cd82-d590-4f38-9daf-11fbe90438c8', '06255911-d5db-4ddb-bbb8-f585857bbf43', 'f4d74b2e-2697-4bf3-a4e6-8a2cccc7e52d', 'af64c597-8152-4293-9231-726f61c9a6fb'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:21 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:21 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:21 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22" returned: 0 in 0.439s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-95549906-45d6-4304-aae8-d8f884b4ec22" released by "_copy_volume_from_snapshot" :: held 4.316s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-40860766-40d6-4f5b-a3a7-27ed827969c5-95549906-45d6-4304-aae8-d8f884b4ec22" released by "_create_volume_from_snapshot" :: held 4.346s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.367s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6317d93-7a30-408e-96af-189fbc2f2de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95549906-45d6-4304-aae8-d8f884b4ec22', 'volume_size': 1, 'snapshot_id': '40860766-40d6-4f5b-a3a7-27ed827969c5'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d097774d-f02b-4889-85d5-3bc0164406a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:21 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Volume volume-95549906-45d6-4304-aae8-d8f884b4ec22 (95549906-45d6-4304-aae8-d8f884b4ec22): created successfully Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d097774d-f02b-4889-85d5-3bc0164406a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Flow 'volume_create_manager' (e972504f-8c6f-4197-a1b3-acf626f1f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:21 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-9227c93f-cfae-4729-83fb-d60750580784 tempest-SnapshotDependencyTests-165415979 None] Created volume successfully. Apr 09 13:36:22 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.410s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:22 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Deleted volume successfully. Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-a2a60d2f-c4cb-46a0-bca7-c9025693b6a1 tempest-VolumeQuotasAdminTestJSON-737530783 None] Lock "cinder-60c00b2a-6ff2-401a-b00a-5bd11232aa89-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "cinder-40860766-40d6-4f5b-a3a7-27ed827969c5-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-40860766-40d6-4f5b-a3a7-27ed827969c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "cinder-quobyte-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "cinder-quobyte-40860766-40d6-4f5b-a3a7-27ed827969c5" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-40860766-40d6-4f5b-a3a7-27ed827969c5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Deleting offline snapshot 40860766-40d6-4f5b-a3a7-27ed827969c5 of volume 6894cfae-ac16-40f7-aa1f-ec6bb02fa723 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] snapshot_file for this snap is: volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[051305e2-d78c-4a07-b6f4-cdc6a57b9abb]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:22 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 Apr 09 13:36:22 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:23 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5" returned: 0 in 0.528s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:36:23 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f2c5a7-b840-44a6-b25b-d84b1550430a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:23 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 Apr 09 13:36:23 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:23 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" returned: 0 in 0.523s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:23 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 Apr 09 13:36:23 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:24 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5" returned: 0 in 0.515s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:24 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5 Apr 09 13:36:24 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:24 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723.40860766-40d6-4f5b-a3a7-27ed827969c5" returned: 0 in 0.459s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-40860766-40d6-4f5b-a3a7-27ed827969c5" released by "_delete_snapshot" :: held 2.082s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" released by "delete_snapshot" :: held 2.100s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:24 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Created reservations ['89154a65-487c-409d-bd72-62187aa7b146', 'b64caa85-7c12-414e-9fea-318c14c69124', '2044ee86-ae38-4225-b492-b84327a1c196', '48249b96-6f38-4bcc-876a-b017e79dc77c'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:24 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Delete snapshot completed successfully. Apr 09 13:36:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-82deb7b9-f59b-463a-b921-f7e17828c456 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-40860766-40d6-4f5b-a3a7-27ed827969c5-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "cinder-6894cfae-ac16-40f7-aa1f-ec6bb02fa723-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-6894cfae-ac16-40f7-aa1f-ec6bb02fa723-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "cinder-quobyte-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:25 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6a5e56-e9bc-41ba-ba8a-d32aae834ff7]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:25 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 Apr 09 13:36:25 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:26 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" returned: 0 in 0.523s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:26 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723 Apr 09 13:36:26 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:26 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" returned: 0 in 0.444s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-6894cfae-ac16-40f7-aa1f-ec6bb02fa723" released by "delete_volume" :: held 1.010s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:26 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Created reservations ['dc36576f-f480-48e5-bf0d-984342e680e4', 'ee9478c6-435d-4b98-a731-4b05d6b9942f', 'e61742c3-2b87-4d0b-841c-659e71eb346c', '52836232-3724-4725-823e-3258c64bbaa0'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:26 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:26 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:27 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.481s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:27 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:27 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Deleted volume successfully. Apr 09 13:36:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-40d41dc3-5229-4901-bb76-5458ac8ad627 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-6894cfae-ac16-40f7-aa1f-ec6bb02fa723-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "cinder-95549906-45d6-4304-aae8-d8f884b4ec22-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-95549906-45d6-4304-aae8-d8f884b4ec22-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "cinder-quobyte-95549906-45d6-4304-aae8-d8f884b4ec22" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-95549906-45d6-4304-aae8-d8f884b4ec22" acquired by "delete_volume" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:27 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5ef193-631c-4ca9-8ba3-ea4e728c6698]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:28 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22 Apr 09 13:36:28 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:28 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22" returned: 0 in 0.529s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:28 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22 Apr 09 13:36:28 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:28 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-95549906-45d6-4304-aae8-d8f884b4ec22" returned: 0 in 0.429s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-quobyte-95549906-45d6-4304-aae8-d8f884b4ec22" released by "delete_volume" :: held 0.984s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:28 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=153,cinder:INSERT=41,cinder:UPDATE=209,cinder:DELETE=12 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:36:28 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:UPDATE=188,cinder:SELECT=161,cinder:DELETE=14,cinder:INSERT=55 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:36:29 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Created reservations ['c3bf722a-d772-4fcb-b964-4375be1d9281', 'eca14845-31f2-4291-9cab-45bd0dfc702f', 'c35385a3-4aca-4450-a9da-7762b0e3b053', 'ea3e7632-7bbd-4058-a4f7-d90932c8f303'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:29 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:29 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:29 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.505s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:29 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:29 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Deleted volume successfully. Apr 09 13:36:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cfca6017-cb72-460f-92f6-fb2377b99d17 tempest-SnapshotDependencyTests-165415979 None] Lock "cinder-95549906-45d6-4304-aae8-d8f884b4ec22-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Flow 'volume_create_manager' (a004e4e1-2862-4ac0-b05a-9aa2a874af33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e289bb54-27ba-4f01-8167-1b694c12b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e289bb54-27ba-4f01-8167-1b694c12b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1185761267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2a291b-79aa-46a7-a7e8-9a198a918100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4be93c850e419da8cdcefd2f66e10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:33Z,use_quota=True,user_id='420ad024b750406a8796d1c3eb85193e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4011502-a7bd-4fb6-a4ab-a518f1a8250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4011502-a7bd-4fb6-a4ab-a518f1a8250e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3a8fd2-fd92-4a4c-923a-facbb07e6521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3a8fd2-fd92-4a4c-923a-facbb07e6521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2a291b-79aa-46a7-a7e8-9a198a918100', 'volume_name': 'volume-8b2a291b-79aa-46a7-a7e8-9a198a918100', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5aae01b-83c4-4d18-87d1-a101033ece3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5aae01b-83c4-4d18-87d1-a101033ece3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef2a940-2b99-47cb-b07d-308475666ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:32 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Volume 8b2a291b-79aa-46a7-a7e8-9a198a918100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2a291b-79aa-46a7-a7e8-9a198a918100', 'volume_size': 1} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1185761267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2a291b-79aa-46a7-a7e8-9a198a918100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4be93c850e419da8cdcefd2f66e10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:33Z,use_quota=True,user_id='420ad024b750406a8796d1c3eb85193e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Creating volume 8b2a291b-79aa-46a7-a7e8-9a198a918100 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:36:32 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:36:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:32 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100 1073741824 Apr 09 13:36:32 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:33 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100 1073741824" returned: 0 in 0.542s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:33 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100 Apr 09 13:36:33 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG oslo_service.periodic_task [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82346) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:33 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:33 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:33 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100" returned: 0 in 0.500s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:33 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.456s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef2a940-2b99-47cb-b07d-308475666ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2a291b-79aa-46a7-a7e8-9a198a918100', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794ea4f4-e180-4dbf-9ceb-72fc161fb9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:33 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Volume volume-8b2a291b-79aa-46a7-a7e8-9a198a918100 (8b2a291b-79aa-46a7-a7e8-9a198a918100): created successfully Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794ea4f4-e180-4dbf-9ceb-72fc161fb9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Flow 'volume_create_manager' (a004e4e1-2862-4ac0-b05a-9aa2a874af33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:33 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-cf848f3f-9e70-4503-b285-e4f7d47bdfb5 tempest-VolumesListAdminTestJSON-18128808 None] Created volume successfully. Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Flow 'volume_create_manager' (ac821eb4-616e-4816-82b7-ded4ca857e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73298bf5-72cd-4d75-a221-2a9589cce834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73298bf5-72cd-4d75-a221-2a9589cce834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1720476211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e48039-3ba7-4d83-a798-a164641a03cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4be93c850e419da8cdcefd2f66e10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:35Z,use_quota=True,user_id='420ad024b750406a8796d1c3eb85193e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4996d93-8c7f-4b00-bca5-4dbc6dd9fa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4996d93-8c7f-4b00-bca5-4dbc6dd9fa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af4196b-2fb9-4cc5-9259-ca9b2aeb49f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af4196b-2fb9-4cc5-9259-ca9b2aeb49f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e48039-3ba7-4d83-a798-a164641a03cf', 'volume_name': 'volume-b5e48039-3ba7-4d83-a798-a164641a03cf', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc99832-140a-48f8-8f64-955bd05cc3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc99832-140a-48f8-8f64-955bd05cc3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394fbbca-6e83-471c-a6d6-a73374aea155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:35 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Volume b5e48039-3ba7-4d83-a798-a164641a03cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e48039-3ba7-4d83-a798-a164641a03cf', 'volume_size': 1} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1720476211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e48039-3ba7-4d83-a798-a164641a03cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4be93c850e419da8cdcefd2f66e10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:35Z,use_quota=True,user_id='420ad024b750406a8796d1c3eb85193e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Creating volume b5e48039-3ba7-4d83-a798-a164641a03cf {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:36:35 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:35 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf 1073741824 Apr 09 13:36:35 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:35 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf 1073741824" returned: 0 in 0.629s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:35 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf Apr 09 13:36:35 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:36 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf" returned: 0 in 0.476s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:36:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394fbbca-6e83-471c-a6d6-a73374aea155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e48039-3ba7-4d83-a798-a164641a03cf', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23170c73-05d0-4a59-bd87-8097f405e636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:36 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Volume volume-b5e48039-3ba7-4d83-a798-a164641a03cf (b5e48039-3ba7-4d83-a798-a164641a03cf): created successfully Apr 09 13:36:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23170c73-05d0-4a59-bd87-8097f405e636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:36 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Flow 'volume_create_manager' (ac821eb4-616e-4816-82b7-ded4ca857e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:36 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3de8dca2-5803-448b-9d00-1135e71803ce tempest-VolumesListAdminTestJSON-18128808 None] Created volume successfully. Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Flow 'volume_create_manager' (d6e3d088-1c5e-4ba1-8a61-71dc735fa5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1931abd6-8eb4-418d-9927-3a84f134829c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1931abd6-8eb4-418d-9927-3a84f134829c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-580549482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff953361-62cb-4594-b441-08035f7a0990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4be93c850e419da8cdcefd2f66e10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:37Z,use_quota=True,user_id='420ad024b750406a8796d1c3eb85193e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcb1e7a-ffa3-4f77-b816-23be1f8b9631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcb1e7a-ffa3-4f77-b816-23be1f8b9631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4136c950-5336-49ae-9520-6f9ede8fe6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4136c950-5336-49ae-9520-6f9ede8fe6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff953361-62cb-4594-b441-08035f7a0990', 'volume_name': 'volume-ff953361-62cb-4594-b441-08035f7a0990', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4f1037-2d3c-4b88-933f-5cab920b844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4f1037-2d3c-4b88-933f-5cab920b844a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2509b571-48c9-4b31-b443-5e5de98259d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:37 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Volume ff953361-62cb-4594-b441-08035f7a0990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff953361-62cb-4594-b441-08035f7a0990', 'volume_size': 1} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-580549482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff953361-62cb-4594-b441-08035f7a0990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4be93c850e419da8cdcefd2f66e10d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:37Z,use_quota=True,user_id='420ad024b750406a8796d1c3eb85193e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Creating volume ff953361-62cb-4594-b441-08035f7a0990 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:36:37 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:36:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:37 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990 1073741824 Apr 09 13:36:37 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:38 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990 1073741824" returned: 0 in 0.524s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:38 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990 Apr 09 13:36:38 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:38 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990" returned: 0 in 0.403s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:36:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2509b571-48c9-4b31-b443-5e5de98259d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff953361-62cb-4594-b441-08035f7a0990', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998b531e-a913-4f2b-85ae-7f28b60be236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:38 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Volume volume-ff953361-62cb-4594-b441-08035f7a0990 (ff953361-62cb-4594-b441-08035f7a0990): created successfully Apr 09 13:36:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998b531e-a913-4f2b-85ae-7f28b60be236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:38 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Flow 'volume_create_manager' (d6e3d088-1c5e-4ba1-8a61-71dc735fa5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:38 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-12cb4e71-4492-49e5-be6d-5389fd8d67df tempest-VolumesListAdminTestJSON-18128808 None] Created volume successfully. Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Flow 'volume_create_manager' (6992f076-7ece-44af-a475-29d913cf1b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daad9b1b-e173-420e-8e76-dd48fe763dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daad9b1b-e173-420e-8e76-dd48fe763dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed5609f-496b-4a96-a07c-09bde0e9b565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0a6dcac44a4746b5907a010e80735d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:40Z,use_quota=True,user_id='e1a85de2ce50465a9848ff8bf2029feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c406fd63-ca8d-45f6-b93a-8ffc44d430dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c406fd63-ca8d-45f6-b93a-8ffc44d430dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a7778a-1b4e-4a11-b5ac-28ceee39d3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a7778a-1b4e-4a11-b5ac-28ceee39d3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed5609f-496b-4a96-a07c-09bde0e9b565', 'volume_name': 'volume-9ed5609f-496b-4a96-a07c-09bde0e9b565', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0394e35-291e-48b0-a95c-6c65bb6c3893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0394e35-291e-48b0-a95c-6c65bb6c3893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff607fe-794b-4d18-a0d8-99a817daa872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:40 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Volume 9ed5609f-496b-4a96-a07c-09bde0e9b565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed5609f-496b-4a96-a07c-09bde0e9b565', 'volume_size': 1} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed5609f-496b-4a96-a07c-09bde0e9b565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0a6dcac44a4746b5907a010e80735d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:40Z,use_quota=True,user_id='e1a85de2ce50465a9848ff8bf2029feb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Creating volume 9ed5609f-496b-4a96-a07c-09bde0e9b565 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:36:40 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:40 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565 1073741824 Apr 09 13:36:40 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:40 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565 1073741824" returned: 0 in 0.552s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:40 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565 Apr 09 13:36:40 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:41 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565" returned: 0 in 0.437s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:41 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:36:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:41 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff607fe-794b-4d18-a0d8-99a817daa872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed5609f-496b-4a96-a07c-09bde0e9b565', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:41 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3faa95d1-bde4-48c5-9223-ed9cde3f727f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:41 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Volume volume-9ed5609f-496b-4a96-a07c-09bde0e9b565 (9ed5609f-496b-4a96-a07c-09bde0e9b565): created successfully Apr 09 13:36:41 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3faa95d1-bde4-48c5-9223-ed9cde3f727f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:41 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Flow 'volume_create_manager' (6992f076-7ece-44af-a475-29d913cf1b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:41 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-73da7250-f09f-40a4-9ef8-89026e39140c tempest-VolumesListAdminTestJSON-1380281202 None] Created volume successfully. Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Acquiring lock "cinder-9ed5609f-496b-4a96-a07c-09bde0e9b565-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Lock "cinder-9ed5609f-496b-4a96-a07c-09bde0e9b565-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Acquiring lock "cinder-quobyte-9ed5609f-496b-4a96-a07c-09bde0e9b565" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Lock "cinder-quobyte-9ed5609f-496b-4a96-a07c-09bde0e9b565" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[badfd216-10a8-43dc-987f-c5decdc21201]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "cinder-ff953361-62cb-4594-b441-08035f7a0990-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-ff953361-62cb-4594-b441-08035f7a0990-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:42 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565 Apr 09 13:36:42 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "cinder-quobyte-ff953361-62cb-4594-b441-08035f7a0990" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-quobyte-ff953361-62cb-4594-b441-08035f7a0990" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e3662f-d9ea-471d-84f5-972c16a5302b]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:42 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990 Apr 09 13:36:42 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:42 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565" returned: 0 in 0.525s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:43 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565 Apr 09 13:36:43 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:43 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990" returned: 0 in 0.471s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:43 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990 Apr 09 13:36:43 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:43 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed5609f-496b-4a96-a07c-09bde0e9b565" returned: 0 in 0.416s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Lock "cinder-quobyte-9ed5609f-496b-4a96-a07c-09bde0e9b565" released by "delete_volume" :: held 0.966s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Created reservations ['c4586822-f535-437c-816c-d70e21ce4974', 'a77ace84-d649-4a1a-b96e-2888c7dd4ee0', '52d29c0b-454f-4858-a561-c8ebc024fa71', 'acc19530-20c9-44f0-9a90-43d752ca72f4'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:43 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ff953361-62cb-4594-b441-08035f7a0990" returned: 0 in 0.434s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-quobyte-ff953361-62cb-4594-b441-08035f7a0990" released by "delete_volume" :: held 0.936s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:43 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:43 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Created reservations ['44858f0c-3e86-43cc-8baa-85e356cec5c0', 'd3a91274-c745-4825-9e34-20a903ca622c', 'c768f9c4-71e1-4716-9a80-739668a5bca2', '1561bdc5-01cb-4d85-b62c-fdb0b4910ebe'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:43 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:43 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "cinder-b5e48039-3ba7-4d83-a798-a164641a03cf-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-b5e48039-3ba7-4d83-a798-a164641a03cf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "cinder-quobyte-b5e48039-3ba7-4d83-a798-a164641a03cf" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-quobyte-b5e48039-3ba7-4d83-a798-a164641a03cf" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8a9719-5ae4-44c8-a4b2-8197153cd438]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:43 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf Apr 09 13:36:43 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:43 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.449s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:43 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Deleted volume successfully. Apr 09 13:36:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1dadbc51-773d-4ffa-9571-f46fbdfd68d2 tempest-VolumesListAdminTestJSON-1380281202 None] Lock "cinder-9ed5609f-496b-4a96-a07c-09bde0e9b565-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:44 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.439s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:44 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Deleted volume successfully. Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9271f949-5f19-474c-83a5-0a4d2e6b6dda tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-ff953361-62cb-4594-b441-08035f7a0990-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:44 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf" returned: 0 in 0.491s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:44 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf Apr 09 13:36:44 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:44 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b5e48039-3ba7-4d83-a798-a164641a03cf" returned: 0 in 0.409s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-quobyte-b5e48039-3ba7-4d83-a798-a164641a03cf" released by "delete_volume" :: held 0.920s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Created reservations ['f10f37be-e622-466c-8168-549986c99901', '463c992e-77ab-4c59-84bf-5e28fce67cc8', '32d20059-8135-478e-8adb-518b76123774', 'b6aa632d-0b88-4887-bef4-594b1e5032af'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:44 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:44 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "cinder-8b2a291b-79aa-46a7-a7e8-9a198a918100-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-8b2a291b-79aa-46a7-a7e8-9a198a918100-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "cinder-quobyte-8b2a291b-79aa-46a7-a7e8-9a198a918100" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-quobyte-8b2a291b-79aa-46a7-a7e8-9a198a918100" acquired by "delete_volume" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a100ce5-c834-4641-9b91-4be6ce36cf5a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:44 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100 Apr 09 13:36:44 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:45 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.463s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:45 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Deleted volume successfully. Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57d2c106-76c2-4b18-a0f3-faac6df3a751 tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-b5e48039-3ba7-4d83-a798-a164641a03cf-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:45 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100" returned: 0 in 0.477s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:45 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100 Apr 09 13:36:45 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:45 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-8b2a291b-79aa-46a7-a7e8-9a198a918100" returned: 0 in 0.413s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-quobyte-8b2a291b-79aa-46a7-a7e8-9a198a918100" released by "delete_volume" :: held 0.911s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Created reservations ['a36eafeb-39f4-4bf7-aec3-76fc680d5130', '29300062-2ae5-41e7-9f1f-cf0b457e827d', '191f0b5a-66c9-4c99-b4c7-25f7259c3295', '92d479b7-a248-4591-9a56-8ca3a55f3510'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:45 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:45 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:46 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.469s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:46 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:46 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Deleted volume successfully. Apr 09 13:36:46 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51dcbad5-58cc-4c5f-88d0-53fe991694e2 tempest-VolumesListAdminTestJSON-18128808 None] Lock "cinder-8b2a291b-79aa-46a7-a7e8-9a198a918100-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Flow 'volume_create_manager' (2326963f-b062-41f1-9da5-8c7463078bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9512aff5-9729-416e-87e8-ebd0298c27c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9512aff5-9729-416e-87e8-ebd0298c27c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1284493545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3969e8-1a54-4e78-83c4-8aec2efeba11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3d52e5a86d462084d37d33e503dc5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:50Z,use_quota=True,user_id='90d8fc036bb346698829af432fcaae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce351e3b-cc65-4b09-bd68-5c0d87c057f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce351e3b-cc65-4b09-bd68-5c0d87c057f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9820ec-a027-4ba5-9122-b006b2542189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9820ec-a027-4ba5-9122-b006b2542189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3969e8-1a54-4e78-83c4-8aec2efeba11', 'volume_name': 'volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb666ea-4c6b-4b4d-998c-c8512f94cd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb666ea-4c6b-4b4d-998c-c8512f94cd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866bf693-da9c-463e-9a2d-9da8dc6ec95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:49 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Volume 4c3969e8-1a54-4e78-83c4-8aec2efeba11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11', 'volume_size': 1} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1284493545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3969e8-1a54-4e78-83c4-8aec2efeba11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f3d52e5a86d462084d37d33e503dc5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:50Z,use_quota=True,user_id='90d8fc036bb346698829af432fcaae49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Creating volume 4c3969e8-1a54-4e78-83c4-8aec2efeba11 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:36:49 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:36:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:49 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11 1073741824 Apr 09 13:36:49 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:50 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11 1073741824" returned: 0 in 0.483s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:50 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11 Apr 09 13:36:50 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:50 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11" returned: 0 in 0.401s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:36:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866bf693-da9c-463e-9a2d-9da8dc6ec95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707c9d40-e379-4dec-8858-030892295a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:50 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Volume volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11 (4c3969e8-1a54-4e78-83c4-8aec2efeba11): created successfully Apr 09 13:36:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707c9d40-e379-4dec-8858-030892295a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Flow 'volume_create_manager' (2326963f-b062-41f1-9da5-8c7463078bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:50 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f038043f-e6e5-4732-8930-41f3be8c3376 tempest-VolumesMetadataTest-2058949687 None] Created volume successfully. Apr 09 13:36:52 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Acquiring lock "cinder-4c3969e8-1a54-4e78-83c4-8aec2efeba11-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:52 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Lock "cinder-4c3969e8-1a54-4e78-83c4-8aec2efeba11-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:52 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Acquiring lock "cinder-quobyte-4c3969e8-1a54-4e78-83c4-8aec2efeba11" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:52 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Lock "cinder-quobyte-4c3969e8-1a54-4e78-83c4-8aec2efeba11" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:52 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a821bd9b-44c0-44a1-ae9c-c4707d5b5682]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:52 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11 Apr 09 13:36:52 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:52 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11" returned: 0 in 0.450s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:52 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11 Apr 09 13:36:52 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:53 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4c3969e8-1a54-4e78-83c4-8aec2efeba11" returned: 0 in 0.412s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Lock "cinder-quobyte-4c3969e8-1a54-4e78-83c4-8aec2efeba11" released by "delete_volume" :: held 0.886s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Created reservations ['12b279e5-fed5-4275-acb5-80168699d231', 'b9c9e0d2-f42b-4155-a913-d032ca16e04d', '1718feed-50ea-4c84-8979-6b09d7aa2664', '6ac0ddde-084a-438a-ad94-7f878a8595e2'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:53 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:36:53 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:53 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.509s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:36:53 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Deleted volume successfully. Apr 09 13:36:53 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ce9434c-d721-4cdf-b3ae-8191faae63ee tempest-VolumesMetadataTest-2058949687 None] Lock "cinder-4c3969e8-1a54-4e78-83c4-8aec2efeba11-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Flow 'volume_create_manager' (0fff9f93-cf91-4bd4-a668-6d3306793cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868027b5-01d7-4223-bd53-6e5b6bfcc1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868027b5-01d7-4223-bd53-6e5b6bfcc1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-628736518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9220347d-d3e9-4b42-a662-883720f29e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ed0021a46f4efa823320b559745998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:56Z,use_quota=True,user_id='44419016ae164d1e8e0028a9a4807e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdbeef9-32da-4b48-9207-397e5fd76644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdbeef9-32da-4b48-9207-397e5fd76644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2efbde1-49ef-4e1f-98e2-87180bce5f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2efbde1-49ef-4e1f-98e2-87180bce5f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9220347d-d3e9-4b42-a662-883720f29e2a', 'volume_name': 'volume-9220347d-d3e9-4b42-a662-883720f29e2a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06d16ee-42c7-4021-82f2-67bfcbad524f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06d16ee-42c7-4021-82f2-67bfcbad524f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b28bc5c-0ceb-4f49-8781-26caf0417ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:55 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Volume 9220347d-d3e9-4b42-a662-883720f29e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9220347d-d3e9-4b42-a662-883720f29e2a', 'volume_size': 1} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-628736518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9220347d-d3e9-4b42-a662-883720f29e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ed0021a46f4efa823320b559745998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:36:56Z,use_quota=True,user_id='44419016ae164d1e8e0028a9a4807e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Creating volume 9220347d-d3e9-4b42-a662-883720f29e2a {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:36:55 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:36:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:56 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a 1073741824 Apr 09 13:36:56 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:56 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a 1073741824" returned: 0 in 0.467s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:56 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a Apr 09 13:36:56 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:56 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a" returned: 0 in 0.400s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:36:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:36:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b28bc5c-0ceb-4f49-8781-26caf0417ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9220347d-d3e9-4b42-a662-883720f29e2a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4185d2bf-f9fa-4ccc-9d48-a6a76b83ede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:36:56 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Volume volume-9220347d-d3e9-4b42-a662-883720f29e2a (9220347d-d3e9-4b42-a662-883720f29e2a): created successfully Apr 09 13:36:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4185d2bf-f9fa-4ccc-9d48-a6a76b83ede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:36:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Flow 'volume_create_manager' (0fff9f93-cf91-4bd4-a668-6d3306793cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:36:56 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-897cbdc1-eccc-423f-b33e-c549d77dc0c3 tempest-VolumesTransfersTest-548345964 None] Created volume successfully. Apr 09 13:36:58 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-54d95c97-06da-47ca-92d4-fc1501c4a467 tempest-VolumesTransfersTest-467122425 None] Transfer volume completed successfully. Apr 09 13:36:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Acquiring lock "cinder-9220347d-d3e9-4b42-a662-883720f29e2a-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Lock "cinder-9220347d-d3e9-4b42-a662-883720f29e2a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Acquiring lock "cinder-quobyte-9220347d-d3e9-4b42-a662-883720f29e2a" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:36:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Lock "cinder-quobyte-9220347d-d3e9-4b42-a662-883720f29e2a" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:36:59 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[369ee653-3f8c-4698-a706-0597cdd4bdba]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:36:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:59 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a Apr 09 13:36:59 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:36:59 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 09 13:36:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a" returned: 0 in 0.480s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:36:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:36:59 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a Apr 09 13:36:59 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:00 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9220347d-d3e9-4b42-a662-883720f29e2a" returned: 0 in 0.405s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Lock "cinder-quobyte-9220347d-d3e9-4b42-a662-883720f29e2a" released by "delete_volume" :: held 0.908s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Created reservations ['4802dc94-9634-4a90-91c3-1e68b650a0b7', '037e9bb5-6a57-4b93-a0e9-f964f29eabcc', '23754fa6-3c07-4f05-83e5-d23dac020746', '4c91cf71-dc05-413e-b380-26150d388adc'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:00 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:00 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Flow 'volume_create_manager' (5723e8fb-ce14-43e0-b04d-4551cfdf49fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cf0e0e-69e0-44ec-a755-cc902e1c66ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cf0e0e-69e0-44ec-a755-cc902e1c66ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-553293851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176f1227-d36e-4c00-8b89-9d39ca092c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ed0021a46f4efa823320b559745998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:01Z,use_quota=True,user_id='44419016ae164d1e8e0028a9a4807e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485c81bc-6be8-415e-b296-6519c57b6fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485c81bc-6be8-415e-b296-6519c57b6fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e3f66e-38d7-45ab-94ab-d244755be206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e3f66e-38d7-45ab-94ab-d244755be206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '176f1227-d36e-4c00-8b89-9d39ca092c99', 'volume_name': 'volume-176f1227-d36e-4c00-8b89-9d39ca092c99', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e87080-2d2c-4d90-8611-313a5c6677c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e87080-2d2c-4d90-8611-313a5c6677c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22b67c3-bfe3-471f-b299-bebf37949683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:00 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Volume 176f1227-d36e-4c00-8b89-9d39ca092c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-176f1227-d36e-4c00-8b89-9d39ca092c99', 'volume_size': 1} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-553293851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176f1227-d36e-4c00-8b89-9d39ca092c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ed0021a46f4efa823320b559745998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:01Z,use_quota=True,user_id='44419016ae164d1e8e0028a9a4807e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Creating volume 176f1227-d36e-4c00-8b89-9d39ca092c99 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:00 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:00 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99 1073741824 Apr 09 13:37:00 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:00 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.503s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:00 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Deleted volume successfully. Apr 09 13:37:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-dbc3cae0-ca76-4234-8df6-c2c0d1f3dd28 tempest-VolumesTransfersTest-1731132085 None] Lock "cinder-9220347d-d3e9-4b42-a662-883720f29e2a-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:01 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99 1073741824" returned: 0 in 0.491s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:01 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99 Apr 09 13:37:01 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:01 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99" returned: 0 in 0.407s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22b67c3-bfe3-471f-b299-bebf37949683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-176f1227-d36e-4c00-8b89-9d39ca092c99', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf84d02-841f-4f59-a7d4-0a70e0333ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:01 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Volume volume-176f1227-d36e-4c00-8b89-9d39ca092c99 (176f1227-d36e-4c00-8b89-9d39ca092c99): created successfully Apr 09 13:37:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf84d02-841f-4f59-a7d4-0a70e0333ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:01 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Flow 'volume_create_manager' (5723e8fb-ce14-43e0-b04d-4551cfdf49fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:01 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e8cb3db9-862e-41ec-800c-81494326e7bd tempest-VolumesTransfersTest-548345964 None] Created volume successfully. Apr 09 13:37:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Acquiring lock "cinder-176f1227-d36e-4c00-8b89-9d39ca092c99-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Lock "cinder-176f1227-d36e-4c00-8b89-9d39ca092c99-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Acquiring lock "cinder-quobyte-176f1227-d36e-4c00-8b89-9d39ca092c99" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Lock "cinder-quobyte-176f1227-d36e-4c00-8b89-9d39ca092c99" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:02 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea7587f-661b-48c0-97ca-fc6669513711]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:03 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99 Apr 09 13:37:03 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:03 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99" returned: 0 in 0.462s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:03 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99 Apr 09 13:37:03 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:03 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-176f1227-d36e-4c00-8b89-9d39ca092c99" returned: 0 in 0.409s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Lock "cinder-quobyte-176f1227-d36e-4c00-8b89-9d39ca092c99" released by "delete_volume" :: held 0.892s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:03 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Created reservations ['952c0770-8717-43ba-a40e-a70c7e59510c', '4743b827-ed8f-4b63-a747-7f53ed7697fa', 'd80e3a27-3aa6-40f9-86e8-9474f084b5d4', '1ad8665f-641d-4292-972c-50b3b2f87570'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:37:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:03 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:03 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:04 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.489s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:04 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:04 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Deleted volume successfully. Apr 09 13:37:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c4db7960-c2bb-4096-b6ea-869fd6865203 tempest-VolumesTransfersTest-1731132085 None] Lock "cinder-176f1227-d36e-4c00-8b89-9d39ca092c99-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Flow 'volume_create_manager' (d14324ff-1c5e-4459-81e4-3d13f0400c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d52f088-f968-45a0-9efc-b57b3452214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d52f088-f968-45a0-9efc-b57b3452214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1722679087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5c7091-f245-4856-9cac-e05ab5ed9c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974d59d8505c4d6c9ac8109c3cb39d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:08Z,use_quota=True,user_id='0a910d25cf6b4703bec86116c2f4b1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f67945c-f78c-419f-bcf7-226f64aefeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f67945c-f78c-419f-bcf7-226f64aefeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d4f3a1-1d14-41fd-986e-1c647f8b29d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d4f3a1-1d14-41fd-986e-1c647f8b29d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5c7091-f245-4856-9cac-e05ab5ed9c95', 'volume_name': 'volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d28bce5-2d95-4200-8076-8fc795136261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d28bce5-2d95-4200-8076-8fc795136261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ab8f93-0dbf-45cd-847c-6ac30baa4333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:08 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Volume 7d5c7091-f245-4856-9cac-e05ab5ed9c95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95', 'volume_size': 1} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1722679087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5c7091-f245-4856-9cac-e05ab5ed9c95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974d59d8505c4d6c9ac8109c3cb39d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:08Z,use_quota=True,user_id='0a910d25cf6b4703bec86116c2f4b1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Creating volume 7d5c7091-f245-4856-9cac-e05ab5ed9c95 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:08 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:08 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95 1073741824 Apr 09 13:37:08 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:08 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95 1073741824" returned: 0 in 0.489s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:08 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95 Apr 09 13:37:08 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:09 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95" returned: 0 in 0.407s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ab8f93-0dbf-45cd-847c-6ac30baa4333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5803a51e-7269-47ff-a81f-30f40dc5b65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:09 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Volume volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95 (7d5c7091-f245-4856-9cac-e05ab5ed9c95): created successfully Apr 09 13:37:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5803a51e-7269-47ff-a81f-30f40dc5b65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Flow 'volume_create_manager' (d14324ff-1c5e-4459-81e4-3d13f0400c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:09 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b02e7e15-ee62-45cc-a7e0-85e0e188bc85 tempest-VolumesTransfersV355Test-245831315 None] Created volume successfully. Apr 09 13:37:10 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-249348bb-b12b-49f6-9706-a1492c5b7cf3 tempest-VolumesTransfersV355Test-274278278 None] Transfer volume completed successfully. Apr 09 13:37:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Acquiring lock "cinder-7d5c7091-f245-4856-9cac-e05ab5ed9c95-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Lock "cinder-7d5c7091-f245-4856-9cac-e05ab5ed9c95-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Acquiring lock "cinder-quobyte-7d5c7091-f245-4856-9cac-e05ab5ed9c95" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Lock "cinder-quobyte-7d5c7091-f245-4856-9cac-e05ab5ed9c95" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:11 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b06c7b-7548-49d7-9eb4-499c3f9fd23c]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:11 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95 Apr 09 13:37:11 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:11 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95" returned: 0 in 0.461s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:11 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95 Apr 09 13:37:11 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:12 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-7d5c7091-f245-4856-9cac-e05ab5ed9c95" returned: 0 in 0.390s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Lock "cinder-quobyte-7d5c7091-f245-4856-9cac-e05ab5ed9c95" released by "delete_volume" :: held 0.883s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Created reservations ['ad09e67f-df7d-4518-9137-12bf934aa50d', '54978ef0-fb2b-469e-9dfe-3d115cd7f0c3', 'd2b3aed0-9aba-4a88-9646-e5edee3b60af', 'df0e6281-ca4a-46c7-be0e-e692e7846ddc'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:12 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:12 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Flow 'volume_create_manager' (24847229-4c7e-4a7e-8177-2af2997cf7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6858c1c2-3eb8-44d8-88e5-9f6ba8319959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:12 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6858c1c2-3eb8-44d8-88e5-9f6ba8319959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1166855280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe9cc9c-bbb4-4f74-adb2-fb7105457e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974d59d8505c4d6c9ac8109c3cb39d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:13Z,use_quota=True,user_id='0a910d25cf6b4703bec86116c2f4b1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd6f2a8-800b-4cb0-9393-196b3d3ade06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd6f2a8-800b-4cb0-9393-196b3d3ade06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b81763-6968-476c-853a-840925650395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b81763-6968-476c-853a-840925650395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe9cc9c-bbb4-4f74-adb2-fb7105457e62', 'volume_name': 'volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a282bee-1f95-474b-a6da-7bcae46be291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a282bee-1f95-474b-a6da-7bcae46be291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6aaf6e2-c296-46fe-87b5-4e1a69986fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:12 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Volume cfe9cc9c-bbb4-4f74-adb2-fb7105457e62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62', 'volume_size': 1} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1166855280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe9cc9c-bbb4-4f74-adb2-fb7105457e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974d59d8505c4d6c9ac8109c3cb39d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:13Z,use_quota=True,user_id='0a910d25cf6b4703bec86116c2f4b1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Creating volume cfe9cc9c-bbb4-4f74-adb2-fb7105457e62 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:12 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.477s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:12 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Deleted volume successfully. Apr 09 13:37:12 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62 1073741824 Apr 09 13:37:12 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-58a54f3e-d2b0-4df0-bc4b-42fba19c0fda tempest-VolumesTransfersV355Test-2015671536 None] Lock "cinder-7d5c7091-f245-4856-9cac-e05ab5ed9c95-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:13 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62 1073741824" returned: 0 in 0.455s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:13 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62 Apr 09 13:37:13 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:13 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62" returned: 0 in 0.401s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6aaf6e2-c296-46fe-87b5-4e1a69986fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5341dd7e-ef1c-47c1-97b1-1c882fdaca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:13 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Volume volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62 (cfe9cc9c-bbb4-4f74-adb2-fb7105457e62): created successfully Apr 09 13:37:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5341dd7e-ef1c-47c1-97b1-1c882fdaca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Flow 'volume_create_manager' (24847229-4c7e-4a7e-8177-2af2997cf7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:13 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ae2a5112-049d-4b2a-8dd6-94a0e89a851e tempest-VolumesTransfersV355Test-245831315 None] Created volume successfully. Apr 09 13:37:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Acquiring lock "cinder-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Lock "cinder-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Acquiring lock "cinder-quobyte-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Lock "cinder-quobyte-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:14 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0538792-0dd2-43bf-9319-4579db4d1ef6]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:14 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62 Apr 09 13:37:14 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:14 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62" returned: 0 in 0.457s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:14 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62 Apr 09 13:37:14 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:14 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62" returned: 0 in 0.392s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Lock "cinder-quobyte-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62" released by "delete_volume" :: held 0.875s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:14 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Created reservations ['aa9f4c2d-2b2b-41b4-8c3c-978967902695', '69b9d984-ebca-4b11-8955-1623559e3fed', 'e5d19087-7cb3-42b4-b91e-1a442a1fb353', 'a8d6faea-989a-4824-acf7-dbdd64f681d3'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:37:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:15 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:15 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:15 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.460s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:15 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:15 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Deleted volume successfully. Apr 09 13:37:15 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d758bad9-2d37-463d-8101-80d8a527ed31 tempest-VolumesTransfersV355Test-2015671536 None] Lock "cinder-cfe9cc9c-bbb4-4f74-adb2-fb7105457e62-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (5015b89b-c891-4ebc-8628-a2a41de8945e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b4f1a4-16ae-4fc5-a281-311f36c56fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b4f1a4-16ae-4fc5-a281-311f36c56fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1001098047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2f4c2a-9894-4fd6-9459-20b9c9925653,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:18Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd904e2-e35b-4b8b-a2d8-44f1c7249765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd904e2-e35b-4b8b-a2d8-44f1c7249765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf61accc-6279-467d-a772-8f1462bf61bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf61accc-6279-467d-a772-8f1462bf61bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2f4c2a-9894-4fd6-9459-20b9c9925653', 'volume_name': 'volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c734b2b-2ca0-4275-9910-bd6c09d2a57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c734b2b-2ca0-4275-9910-bd6c09d2a57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e064cca1-1cad-4eda-9f26-052222d1b17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:18 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Volume cf2f4c2a-9894-4fd6-9459-20b9c9925653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653', 'volume_size': 1} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1001098047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2f4c2a-9894-4fd6-9459-20b9c9925653,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:18Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Creating volume cf2f4c2a-9894-4fd6-9459-20b9c9925653 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:18 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:18 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653 1073741824 Apr 09 13:37:18 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:18 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653 1073741824" returned: 0 in 0.453s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:18 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653 Apr 09 13:37:18 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:19 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653" returned: 0 in 0.411s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e064cca1-1cad-4eda-9f26-052222d1b17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ac3c07-6bba-44f6-811d-6e64a06e059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:19 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Volume volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653 (cf2f4c2a-9894-4fd6-9459-20b9c9925653): created successfully Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ac3c07-6bba-44f6-811d-6e64a06e059a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (5015b89b-c891-4ebc-8628-a2a41de8945e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:19 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-436c7ec5-f91a-44f1-bad1-ef33d070229c tempest-VolumesGetTest-673503908 None] Created volume successfully. Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (334a6c43-e49e-46e4-ac13-1188240bb93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c71969-d602-444c-b47c-7b332962bdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c71969-d602-444c-b47c-7b332962bdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1888180324',display_name='tempest-VolumesGetTest-Volume-380068518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d848cc08-38c7-4db2-80b1-76f93d94529a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:20Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fac89b-e73b-4d68-8469-0bf2707d4ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fac89b-e73b-4d68-8469-0bf2707d4ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d71315c-c89a-4a17-b69a-abf6c59b466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d71315c-c89a-4a17-b69a-abf6c59b466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd848cc08-38c7-4db2-80b1-76f93d94529a', 'volume_name': 'volume-d848cc08-38c7-4db2-80b1-76f93d94529a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed6b6aa-1135-492e-a1e7-50f26ec612d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed6b6aa-1135-492e-a1e7-50f26ec612d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b5dd90-6a9a-4721-bc02-a65288d68b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:19 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Volume d848cc08-38c7-4db2-80b1-76f93d94529a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d848cc08-38c7-4db2-80b1-76f93d94529a', 'volume_size': 1} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1888180324',display_name='tempest-VolumesGetTest-Volume-380068518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d848cc08-38c7-4db2-80b1-76f93d94529a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:20Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Creating volume d848cc08-38c7-4db2-80b1-76f93d94529a {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:19 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:19 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a 1073741824 Apr 09 13:37:19 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:20 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a 1073741824" returned: 0 in 0.454s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:20 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a Apr 09 13:37:20 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:20 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a" returned: 0 in 0.398s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b5dd90-6a9a-4721-bc02-a65288d68b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d848cc08-38c7-4db2-80b1-76f93d94529a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac6af84-5668-4249-a822-d3aab517548e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Volume volume-d848cc08-38c7-4db2-80b1-76f93d94529a (d848cc08-38c7-4db2-80b1-76f93d94529a): created successfully Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac6af84-5668-4249-a822-d3aab517548e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (334a6c43-e49e-46e4-ac13-1188240bb93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:20 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-4c762ee5-8c65-4fd6-920e-b692f86d5016 tempest-VolumesGetTest-673503908 None] Created volume successfully. Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-d848cc08-38c7-4db2-80b1-76f93d94529a-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Lock "cinder-d848cc08-38c7-4db2-80b1-76f93d94529a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-quobyte-d848cc08-38c7-4db2-80b1-76f93d94529a" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-d848cc08-38c7-4db2-80b1-76f93d94529a" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[98475525-727b-4540-b1f0-3135fcb116e1]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:20 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a Apr 09 13:37:20 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:21 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a" returned: 0 in 0.449s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:21 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a Apr 09 13:37:21 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:21 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d848cc08-38c7-4db2-80b1-76f93d94529a" returned: 0 in 0.404s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-d848cc08-38c7-4db2-80b1-76f93d94529a" released by "delete_volume" :: held 0.880s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Created reservations ['f82c6fa6-bf43-4792-9545-45e8fcae276b', '914b196b-b2e6-4e49-8769-4ebc25224f3c', 'd4194142-ebb1-4e4a-afe0-ff0f456f8ba9', '33e8a3fa-10c9-4c5a-bc1d-44c63d2def13'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:21 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:21 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-cf2f4c2a-9894-4fd6-9459-20b9c9925653-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Lock "cinder-cf2f4c2a-9894-4fd6-9459-20b9c9925653-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-quobyte-cf2f4c2a-9894-4fd6-9459-20b9c9925653" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-cf2f4c2a-9894-4fd6-9459-20b9c9925653" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[4233c18c-656b-49a1-bb41-becbbe1500ce]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:22 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653 Apr 09 13:37:22 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:22 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.420s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:22 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Deleted volume successfully. Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1aa339f-1987-483a-be07-2023b6f58257 tempest-VolumesGetTest-673503908 None] Lock "cinder-d848cc08-38c7-4db2-80b1-76f93d94529a-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:22 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653" returned: 0 in 0.463s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:22 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653 Apr 09 13:37:22 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:22 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-cf2f4c2a-9894-4fd6-9459-20b9c9925653" returned: 0 in 0.387s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-cf2f4c2a-9894-4fd6-9459-20b9c9925653" released by "delete_volume" :: held 0.881s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Created reservations ['17985dc7-a7f7-466e-a5eb-349156414ada', 'c21068d7-206e-4e2c-be66-980e7079d457', '8dc6cc0b-457d-4a76-8c87-8b1138a3bdf7', 'd26390e5-0835-4e1d-ba48-51a4acd5122e'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:22 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:22 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (6f8a4d35-fe90-40e9-ad03-6906b19615b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14753945-c509-4708-8ab0-c74a89bd7798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:23 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14753945-c509-4708-8ab0-c74a89bd7798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-842459001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a352872b-c46c-43b0-909d-a102679f1869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:23Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d118f7-b93b-40d4-9570-eee04cb974dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d118f7-b93b-40d4-9570-eee04cb974dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b976f9a4-65fe-4d01-9fa4-f859b954e578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b976f9a4-65fe-4d01-9fa4-f859b954e578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a352872b-c46c-43b0-909d-a102679f1869', 'volume_name': 'volume-a352872b-c46c-43b0-909d-a102679f1869', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8986dd75-b021-486c-8118-8d7425565cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8986dd75-b021-486c-8118-8d7425565cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c2424f-867d-4e43-bdfa-b76644b8c498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:23 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Volume a352872b-c46c-43b0-909d-a102679f1869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a352872b-c46c-43b0-909d-a102679f1869', 'volume_size': 1} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-842459001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a352872b-c46c-43b0-909d-a102679f1869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:23Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Creating volume a352872b-c46c-43b0-909d-a102679f1869 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:23 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.454s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:23 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Deleted volume successfully. Apr 09 13:37:23 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 1073741824 Apr 09 13:37:23 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c47134e6-3b57-4d15-b7c5-406f1fbdba99 tempest-VolumesGetTest-673503908 None] Lock "cinder-cf2f4c2a-9894-4fd6-9459-20b9c9925653-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:23 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 1073741824" returned: 0 in 0.462s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:23 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 Apr 09 13:37:23 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:24 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869" returned: 0 in 0.401s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c2424f-867d-4e43-bdfa-b76644b8c498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a352872b-c46c-43b0-909d-a102679f1869', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895e41a1-498a-4d75-80c8-f990b9789255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:24 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Volume volume-a352872b-c46c-43b0-909d-a102679f1869 (a352872b-c46c-43b0-909d-a102679f1869): created successfully Apr 09 13:37:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (895e41a1-498a-4d75-80c8-f990b9789255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:24 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (6f8a4d35-fe90-40e9-ad03-6906b19615b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:24 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3e64e64e-9347-4ce6-b47b-a226dc58a4af tempest-VolumesGetTest-673503908 None] Created volume successfully. Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (e3aa237b-487a-4d4f-ab51-47b8b2103490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c713a5-41bf-4c15-89c2-f6df3751fa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c713a5-41bf-4c15-89c2-f6df3751fa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1270058206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0651840-fe4b-44f9-bde8-5fe7ccc372f9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a352872b-c46c-43b0-909d-a102679f1869,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:26Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37cc32a8-f89b-4d8c-97fb-1314c17addd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37cc32a8-f89b-4d8c-97fb-1314c17addd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3546c1ef-2b0e-4f0e-850e-2ac0af81b392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3546c1ef-2b0e-4f0e-850e-2ac0af81b392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e0651840-fe4b-44f9-bde8-5fe7ccc372f9', 'volume_name': 'volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9', 'volume_size': 1, 'source_volid': 'a352872b-c46c-43b0-909d-a102679f1869', 'source_volstatus': 'available'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7ceba5-c96d-4436-a9f2-fc14bf9843cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7ceba5-c96d-4436-a9f2-fc14bf9843cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc9684b-c160-405e-9916-a52df7c7ca33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:25 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Volume e0651840-fe4b-44f9-bde8-5fe7ccc372f9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9', 'volume_size': 1, 'source_volid': 'a352872b-c46c-43b0-909d-a102679f1869', 'source_volstatus': 'available'} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:25 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Cloning volume a352872b-c46c-43b0-909d-a102679f1869 to volume e0651840-fe4b-44f9-bde8-5fe7ccc372f9 Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Creating offline snapshot 503ed504-acaa-4dcd-8104-6871666460e2 of volume a352872b-c46c-43b0-909d-a102679f1869 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59832e5-4da0-4f0f-962b-57bca4268168]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:25 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 Apr 09 13:37:25 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:26 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869" returned: 0 in 0.465s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:26 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 1G Apr 09 13:37:26 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:26 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 1G" returned: 0 in 0.494s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a352872b-c46c-43b0-909d-a102679f1869 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:26 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a352872b-c46c-43b0-909d-a102679f1869 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 Apr 09 13:37:26 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:27 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a352872b-c46c-43b0-909d-a102679f1869 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2" returned: 0 in 0.410s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:27 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 is being set with open permissions: ugo+rw Apr 09 13:37:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:27 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 Apr 09 13:37:27 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:27 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2" returned: 0 in 0.414s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:27 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.info Apr 09 13:37:27 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:27 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.info" returned: 0 in 0.429s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:27 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.info is being set with open permissions: ugo+rw Apr 09 13:37:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:27 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.info Apr 09 13:37:27 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:28 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.info" returned: 0 in 0.407s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-quobyte-e0651840-fe4b-44f9-bde8-5fe7ccc372f9" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-e0651840-fe4b-44f9-bde8-5fe7ccc372f9" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] snapshot: 503ed504-acaa-4dcd-8104-6871666460e2, volume: e0651840-fe4b-44f9-bde8-5fe7ccc372f9, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[1681577e-32bc-436b-927a-c6b8e18c069c]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:28 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 Apr 09 13:37:28 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:28 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2" returned: 0 in 0.471s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a352872b-c46c-43b0-909d-a102679f1869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf65f17-64cb-427d-99b6-0ee6d1b40f3f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:28 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 Apr 09 13:37:28 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:29 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869" returned: 0 in 0.443s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:29 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:37:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:29 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 Apr 09 13:37:29 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:31 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9" returned: 0 in 1.734s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:31 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c0e653-2b21-4c22-a7a6-a98319236555]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:31 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 Apr 09 13:37:31 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:31 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869" returned: 0 in 0.570s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:31 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869, size 1024.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:37:31 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Converted 1024.00 MB image at 590.03 MB/s Apr 09 13:37:31 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 is being set with open permissions: ugo+rw Apr 09 13:37:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:31 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 Apr 09 13:37:31 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:32 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9" returned: 0 in 0.410s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-e0651840-fe4b-44f9-bde8-5fe7ccc372f9" released by "_copy_volume_from_snapshot" :: held 3.667s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:INSERT=31,cinder:UPDATE=133,cinder:SELECT=82,cinder:DELETE=9 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-quobyte-503ed504-acaa-4dcd-8104-6871666460e2" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-503ed504-acaa-4dcd-8104-6871666460e2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Deleting offline snapshot 503ed504-acaa-4dcd-8104-6871666460e2 of volume a352872b-c46c-43b0-909d-a102679f1869 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] snapshot_file for this snap is: volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94b565b-a55a-4333-91b3-ef19dd67615e]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:32 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 Apr 09 13:37:32 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:32 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2" returned: 0 in 0.461s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a352872b-c46c-43b0-909d-a102679f1869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c28c7aa-f3e2-4c33-8d0e-916b2679566d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:32 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 Apr 09 13:37:32 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:33 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869" returned: 0 in 0.458s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:33 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 Apr 09 13:37:33 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_service.periodic_task [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82346) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:33 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:33 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:33 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2" returned: 0 in 0.448s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:33 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2 Apr 09 13:37:33 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:33 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.425s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:33 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869.503ed504-acaa-4dcd-8104-6871666460e2" returned: 0 in 0.404s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-503ed504-acaa-4dcd-8104-6871666460e2" released by "_delete_snapshot" :: held 1.814s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=92,cinder:INSERT=31,cinder:UPDATE=134,cinder:DELETE=15 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.211s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc9684b-c160-405e-9916-a52df7c7ca33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9', 'volume_size': 1, 'source_volid': 'a352872b-c46c-43b0-909d-a102679f1869', 'source_volstatus': 'available'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77950109-5746-4001-9a79-09a6c6ac4141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:33 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Volume volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 (e0651840-fe4b-44f9-bde8-5fe7ccc372f9): created successfully Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77950109-5746-4001-9a79-09a6c6ac4141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (e3aa237b-487a-4d4f-ab51-47b8b2103490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:33 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-1f9d5de1-d0b3-4a00-9994-b5b70d12a438 tempest-VolumesGetTest-673503908 None] Created volume successfully. Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (f9ae37d1-6b4e-4199-8143-a7953e2abb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9400e81-0217-4878-bba7-29a1da0827b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9400e81-0217-4878-bba7-29a1da0827b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-525445399',display_name='tempest-VolumesGetTest-Volume-582936897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f146572-9c33-4998-96f9-0d9f61456cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:34Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc5ef02-6a36-4078-9373-241637f81141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc5ef02-6a36-4078-9373-241637f81141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6d1e33-f804-4956-b647-6728568036b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6d1e33-f804-4956-b647-6728568036b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f146572-9c33-4998-96f9-0d9f61456cd7', 'volume_name': 'volume-4f146572-9c33-4998-96f9-0d9f61456cd7', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40f00c4-1be3-43b9-9e9c-8c5605cc81b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40f00c4-1be3-43b9-9e9c-8c5605cc81b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f36731-d660-4154-bfd9-7e65e1c72cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:34 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Volume 4f146572-9c33-4998-96f9-0d9f61456cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f146572-9c33-4998-96f9-0d9f61456cd7', 'volume_size': 1} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-525445399',display_name='tempest-VolumesGetTest-Volume-582936897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f146572-9c33-4998-96f9-0d9f61456cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:34Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Creating volume 4f146572-9c33-4998-96f9-0d9f61456cd7 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:34 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:34 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7 1073741824 Apr 09 13:37:34 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:35 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7 1073741824" returned: 0 in 0.468s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:35 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7 Apr 09 13:37:35 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:35 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7" returned: 0 in 0.399s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f36731-d660-4154-bfd9-7e65e1c72cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f146572-9c33-4998-96f9-0d9f61456cd7', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c2bdda-5420-416a-a9f6-d4c80e5989bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:35 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Volume volume-4f146572-9c33-4998-96f9-0d9f61456cd7 (4f146572-9c33-4998-96f9-0d9f61456cd7): created successfully Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c2bdda-5420-416a-a9f6-d4c80e5989bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (f9ae37d1-6b4e-4199-8143-a7953e2abb31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:35 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-4a1d8382-cb43-4822-adba-67976cf459e9 tempest-VolumesGetTest-673503908 None] Created volume successfully. Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-4f146572-9c33-4998-96f9-0d9f61456cd7-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Lock "cinder-4f146572-9c33-4998-96f9-0d9f61456cd7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-quobyte-4f146572-9c33-4998-96f9-0d9f61456cd7" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-4f146572-9c33-4998-96f9-0d9f61456cd7" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb141b1-5197-47f3-847b-7060a015b3ab]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:35 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7 Apr 09 13:37:35 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:36 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7" returned: 0 in 0.456s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:36 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7 Apr 09 13:37:36 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:36 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f146572-9c33-4998-96f9-0d9f61456cd7" returned: 0 in 0.395s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-4f146572-9c33-4998-96f9-0d9f61456cd7" released by "delete_volume" :: held 0.877s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Created reservations ['b6434853-5420-4bee-8b69-a1f432ff7a87', '8250d604-144a-4569-a62b-8fa40defdd86', '607e393b-becf-49a2-86d0-ca63db3328d1', 'ac662665-f0fe-45a4-8636-f0ad130d0f4c'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:36 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:36 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-e0651840-fe4b-44f9-bde8-5fe7ccc372f9-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Lock "cinder-e0651840-fe4b-44f9-bde8-5fe7ccc372f9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-quobyte-e0651840-fe4b-44f9-bde8-5fe7ccc372f9" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-e0651840-fe4b-44f9-bde8-5fe7ccc372f9" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45d78e7-96be-4a09-87fa-1b127b75709c]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:36 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 Apr 09 13:37:36 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:37 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.452s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:37 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Deleted volume successfully. Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-93842331-216b-43ac-bb70-84f32e556023 tempest-VolumesGetTest-673503908 None] Lock "cinder-4f146572-9c33-4998-96f9-0d9f61456cd7-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:37 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9" returned: 0 in 0.468s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:37 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9 Apr 09 13:37:37 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:37 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-e0651840-fe4b-44f9-bde8-5fe7ccc372f9" returned: 0 in 0.411s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-e0651840-fe4b-44f9-bde8-5fe7ccc372f9" released by "delete_volume" :: held 0.905s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Created reservations ['11f16623-2696-49d6-8f37-a4c969b5ef8c', 'bc402c8c-6558-46b6-a66f-236b424a41c4', '7182b538-9ac8-404a-ad6c-3a4b306bb89f', 'f4409223-db6f-4ba2-abb6-1989ac1ea3be'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:37 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:37 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-a352872b-c46c-43b0-909d-a102679f1869-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Lock "cinder-a352872b-c46c-43b0-909d-a102679f1869-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-quobyte-a352872b-c46c-43b0-909d-a102679f1869" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-a352872b-c46c-43b0-909d-a102679f1869" acquired by "delete_volume" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe94f75-5884-43a1-bb6e-aac28b4b1568]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:38 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 Apr 09 13:37:38 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:38 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.433s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:38 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Deleted volume successfully. Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d4929ad-a599-4750-a56e-715f91c62558 tempest-VolumesGetTest-673503908 None] Lock "cinder-e0651840-fe4b-44f9-bde8-5fe7ccc372f9-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:38 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869" returned: 0 in 0.464s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:38 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869 Apr 09 13:37:38 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:38 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a352872b-c46c-43b0-909d-a102679f1869" returned: 0 in 0.400s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-a352872b-c46c-43b0-909d-a102679f1869" released by "delete_volume" :: held 0.892s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:38 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Created reservations ['3d43a4c5-6eab-42cd-99d4-5656e23ed0dc', '9de09c54-68f3-4d1c-8576-637d8e05b32e', 'e8391501-8187-4cd3-a573-b56036e0896d', 'c3478137-08aa-4631-931c-525ac16d4453'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:39 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:39 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:39 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.457s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:39 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Deleted volume successfully. Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (cac8efa4-0006-495a-a9c3-d543585f042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8146d132-8855-4117-b37b-1bbebd952ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-80848c0b-3c26-419c-a8e3-51d73cbd911b tempest-VolumesGetTest-673503908 None] Lock "cinder-a352872b-c46c-43b0-909d-a102679f1869-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8146d132-8855-4117-b37b-1bbebd952ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-488581704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9e79d2-d531-4e32-83b1-a11cd4499259,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:39Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ab4024-1536-4ec9-b6ef-f1e8287945e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ab4024-1536-4ec9-b6ef-f1e8287945e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12f3571-3611-4f0c-988d-5d4d5faa0a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.image.glance [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Creating Keystone auth plugin from conf {{(pid=82346) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12f3571-3611-4f0c-988d-5d4d5faa0a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e9e79d2-d531-4e32-83b1-a11cd4499259', 'volume_name': 'volume-2e9e79d2-d531-4e32-83b1-a11cd4499259', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d260e350-2819-4e32-998f-14582d5cb8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d260e350-2819-4e32-998f-14582d5cb8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4340830c-3274-46a5-bfe5-cbc4c97668cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:39 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Volume 2e9e79d2-d531-4e32-83b1-a11cd4499259: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e9e79d2-d531-4e32-83b1-a11cd4499259', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Trying to clone 2e9e79d2-d531-4e32-83b1-a11cd4499259 from image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e at location (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]). {{(pid=82346) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 09 13:37:39 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Image download 20.69 MB at 20.69 MB/s Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aa918a-cec9-45c1-9473-1e3634c5df8a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:40 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD Apr 09 13:37:40 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:40 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD" returned: 0 in 0.455s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Temporary image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e is fetched for user 349a15ff0e8e46c38d5af552d1842549. {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fed7b5-b836-4729-92bb-600426c4001d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:40 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD Apr 09 13:37:40 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:40 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-488581704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9e79d2-d531-4e32-83b1-a11cd4499259,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:39Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Creating volume 2e9e79d2-d531-4e32-83b1-a11cd4499259 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:40 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:40 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 1073741824 Apr 09 13:37:40 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:41 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 1073741824" returned: 0 in 0.465s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:41 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 Apr 09 13:37:41 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:41 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259" returned: 0 in 0.422s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:41 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:41 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Attempting download of eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e ((None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}])) to volume 2e9e79d2-d531-4e32-83b1-a11cd4499259. {{(pid=82346) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 09 13:37:41 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d484787-8a3d-47f0-8742-f46b7f09a24f]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_iacyiphp {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:41 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_iacyiphp Apr 09 13:37:41 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:42 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_iacyiphp" returned: 0 in 0.447s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_iacyiphp {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:42 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_iacyiphp Apr 09 13:37:42 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:42 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_iacyiphp" returned: 1 in 0.440s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_iacyiphp' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:37:42 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d6b948-3c04-4c98-9eb6-9bb4ed889364]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:42 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD Apr 09 13:37:42 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:43 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:43 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e was qcow2, converting to raw {{(pid=82346) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 09 13:37:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:43 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 Apr 09 13:37:43 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:44 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259" returned: 0 in 0.784s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:44 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e_p7yxn2__devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:37:44 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Converted 112.00 MB image at 112.00 MB/s Apr 09 13:37:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:44 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 1G Apr 09 13:37:44 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:44 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 1G" returned: 0 in 0.414s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:44 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d77fdb0-a054-4cde-9c7b-12cb181c79d4]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:44 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 Apr 09 13:37:44 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:44 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259" returned: 0 in 0.451s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:44 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 Apr 09 13:37:44 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:45 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259" returned: 1 in 0.452s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:37:45 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Downloaded image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e ((None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}])) to volume 2e9e79d2-d531-4e32-83b1-a11cd4499259 successfully. {{(pid=82346) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 09 13:37:45 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Temporary image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e for user 349a15ff0e8e46c38d5af552d1842549 is deleted. {{(pid=82346) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 09 13:37:45 devstack cinder-volume[82346]: DEBUG cinder.volume.volume_utils [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Marking volume 2e9e79d2-d531-4e32-83b1-a11cd4499259 as bootable. {{(pid=82346) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 09 13:37:45 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Copying metadata from image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e to 2e9e79d2-d531-4e32-83b1-a11cd4499259. {{(pid=82346) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 09 13:37:45 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Creating volume glance metadata for volume 2e9e79d2-d531-4e32-83b1-a11cd4499259 backed by image eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82346) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 09 13:37:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4340830c-3274-46a5-bfe5-cbc4c97668cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9e79d2-d531-4e32-83b1-a11cd4499259', 'volume_size': 1, 'image_id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ce9ccd437c604ed5a4745e2533b26f71', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e', 'created_at': datetime.datetime(2026, 4, 9, 11, 24, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 9, 11, 24, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eaa4c627-3dcd-4a95-ba11-d0fd7fd6a05e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90de676-26da-4eb5-adec-d5859869894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:45 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Volume volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 (2e9e79d2-d531-4e32-83b1-a11cd4499259): created successfully Apr 09 13:37:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90de676-26da-4eb5-adec-d5859869894a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:45 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (cac8efa4-0006-495a-a9c3-d543585f042f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:45 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-62f17b9c-44dc-4738-9355-1f6005342e6b tempest-VolumesGetTest-673503908 None] Created volume successfully. Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (a10dc003-fa7a-4473-9765-4a1be1801d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49a093b-8068-483b-ad5d-46b591500bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49a093b-8068-483b-ad5d-46b591500bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-441159078',display_name='tempest-VolumesGetTest-Volume-1595850204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5b3eef-0886-4042-8edb-8e76818d0823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:46Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d58e1a-fd9f-4c9c-aa9d-c552d61df9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d58e1a-fd9f-4c9c-aa9d-c552d61df9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861a024b-05ae-4d58-8ee3-9a08492cd7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861a024b-05ae-4d58-8ee3-9a08492cd7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd5b3eef-0886-4042-8edb-8e76818d0823', 'volume_name': 'volume-fd5b3eef-0886-4042-8edb-8e76818d0823', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32224011-caa1-4146-844b-6ce76f089311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32224011-caa1-4146-844b-6ce76f089311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22e4479-5bcd-4001-9b2f-9ec96a815b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:46 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Volume fd5b3eef-0886-4042-8edb-8e76818d0823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd5b3eef-0886-4042-8edb-8e76818d0823', 'volume_size': 1} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-441159078',display_name='tempest-VolumesGetTest-Volume-1595850204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5b3eef-0886-4042-8edb-8e76818d0823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b2d28c36e2458bb78562e68105de28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:46Z,use_quota=True,user_id='349a15ff0e8e46c38d5af552d1842549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Creating volume fd5b3eef-0886-4042-8edb-8e76818d0823 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:46 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:46 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823 1073741824 Apr 09 13:37:46 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:46 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823 1073741824" returned: 0 in 0.475s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:46 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823 Apr 09 13:37:46 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:47 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823" returned: 0 in 0.397s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:47 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22e4479-5bcd-4001-9b2f-9ec96a815b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd5b3eef-0886-4042-8edb-8e76818d0823', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d874cb-b2e4-43cc-80c0-6d840433de29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:47 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Volume volume-fd5b3eef-0886-4042-8edb-8e76818d0823 (fd5b3eef-0886-4042-8edb-8e76818d0823): created successfully Apr 09 13:37:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d874cb-b2e4-43cc-80c0-6d840433de29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:47 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Flow 'volume_create_manager' (a10dc003-fa7a-4473-9765-4a1be1801d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:47 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-4f7e89e5-65d5-4b33-984e-d8bf2ca9f59a tempest-VolumesGetTest-673503908 None] Created volume successfully. Apr 09 13:37:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-fd5b3eef-0886-4042-8edb-8e76818d0823-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Lock "cinder-fd5b3eef-0886-4042-8edb-8e76818d0823-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-quobyte-fd5b3eef-0886-4042-8edb-8e76818d0823" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-fd5b3eef-0886-4042-8edb-8e76818d0823" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:48 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc92cd0-618c-4580-a056-1daaa6e04b47]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:48 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823 Apr 09 13:37:48 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:48 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823" returned: 0 in 0.456s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:48 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823 Apr 09 13:37:48 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:49 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fd5b3eef-0886-4042-8edb-8e76818d0823" returned: 0 in 0.398s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-fd5b3eef-0886-4042-8edb-8e76818d0823" released by "delete_volume" :: held 0.880s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Created reservations ['fde8efb0-9ff7-4a92-93ce-ecbd2b5b106b', '0d6575c0-ae9e-48c7-b5a8-19818401d919', '9a840603-7cf3-4c37-a790-2117a94ff058', 'f290488e-eee3-46e1-af84-f7dc119e8792'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:49 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:49 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-2e9e79d2-d531-4e32-83b1-a11cd4499259-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Lock "cinder-2e9e79d2-d531-4e32-83b1-a11cd4499259-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Acquiring lock "cinder-quobyte-2e9e79d2-d531-4e32-83b1-a11cd4499259" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-2e9e79d2-d531-4e32-83b1-a11cd4499259" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c88b351-9c25-4c82-a0dc-0d3531a196f6]: (4, 'raw') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:49 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 Apr 09 13:37:49 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:49 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.449s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:49 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Deleted volume successfully. Apr 09 13:37:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-17b0bae5-89cf-429f-8d12-e0b10e0be4bc tempest-VolumesGetTest-673503908 None] Lock "cinder-fd5b3eef-0886-4042-8edb-8e76818d0823-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:50 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259" returned: 0 in 0.468s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:50 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 Apr 09 13:37:50 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:50 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259" returned: 1 in 0.448s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259' failed. Not Retrying. {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 09 13:37:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:50 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259 Apr 09 13:37:50 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:51 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2e9e79d2-d531-4e32-83b1-a11cd4499259" returned: 0 in 0.416s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Lock "cinder-quobyte-2e9e79d2-d531-4e32-83b1-a11cd4499259" released by "delete_volume" :: held 1.378s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Created reservations ['99cf52bf-43bd-4e81-9387-faf9a5e3120b', 'ef5f5fa5-7375-444a-8dd2-7a9a3b720dc1', 'd1bb0c42-7f35-4d34-88a2-aabfb85506fe', 'f5b955c1-2f64-4013-8fdf-020ffc36a264'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:51 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:37:51 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:51 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.397s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:37:51 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Deleted volume successfully. Apr 09 13:37:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-51e8daf3-9fb2-474e-85cd-7942ff37c420 tempest-VolumesGetTest-673503908 None] Lock "cinder-2e9e79d2-d531-4e32-83b1-a11cd4499259-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Flow 'volume_create_manager' (859b3fab-3aaa-447b-8286-529f31508532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd25486-3fae-47b2-8738-492686d06a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd25486-3fae-47b2-8738-492686d06a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1559125517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75be4a8-cae0-4262-9e5d-c604c3a59c10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4538392faef04bf689721b4eb91970a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:53Z,use_quota=True,user_id='f27defbc5db24b7baeb578e27328f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb67f39f-7afc-4bae-b2a3-92f57694c094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb67f39f-7afc-4bae-b2a3-92f57694c094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3019a14-972a-44da-9ace-8318bdbbe8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3019a14-972a-44da-9ace-8318bdbbe8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75be4a8-cae0-4262-9e5d-c604c3a59c10', 'volume_name': 'volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1593b93-ea87-485b-a3d2-5e9c323f42c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1593b93-ea87-485b-a3d2-5e9c323f42c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512e4698-c5f1-4345-a7ab-f1a5975de53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:53 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Volume f75be4a8-cae0-4262-9e5d-c604c3a59c10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10', 'volume_size': 1} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1559125517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75be4a8-cae0-4262-9e5d-c604c3a59c10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4538392faef04bf689721b4eb91970a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:53Z,use_quota=True,user_id='f27defbc5db24b7baeb578e27328f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Creating volume f75be4a8-cae0-4262-9e5d-c604c3a59c10 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:53 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:53 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10 1073741824 Apr 09 13:37:53 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:53 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10 1073741824" returned: 0 in 0.492s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:53 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10 Apr 09 13:37:53 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:54 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10" returned: 0 in 0.406s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512e4698-c5f1-4345-a7ab-f1a5975de53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e055789-be3d-4db4-a5b1-a86fd6bdb5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:54 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Volume volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10 (f75be4a8-cae0-4262-9e5d-c604c3a59c10): created successfully Apr 09 13:37:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e055789-be3d-4db4-a5b1-a86fd6bdb5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Flow 'volume_create_manager' (859b3fab-3aaa-447b-8286-529f31508532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:54 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f52cf01b-8e54-4cca-9512-a3dddeae4fa7 tempest-VolumesListTestJSON-1231392514 None] Created volume successfully. Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Flow 'volume_create_manager' (e771254d-9855-4a23-8f79-241e193df58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef43130d-5af5-4ef5-abc2-e6fcac3d8f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef43130d-5af5-4ef5-abc2-e6fcac3d8f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-903156024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cccdd64-3a30-4ddb-8265-94c439d5dcea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4538392faef04bf689721b4eb91970a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:56Z,use_quota=True,user_id='f27defbc5db24b7baeb578e27328f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5c8c38-5823-472d-828b-a93d230c05fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5c8c38-5823-472d-828b-a93d230c05fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e57904d-d030-4c7d-abde-a31ed2bfe61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e57904d-d030-4c7d-abde-a31ed2bfe61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cccdd64-3a30-4ddb-8265-94c439d5dcea', 'volume_name': 'volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2f9e8b-5701-4994-bf12-41a79dc5c4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2f9e8b-5701-4994-bf12-41a79dc5c4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c11206-bc83-4b8c-829b-3c28980c7d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:55 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Volume 1cccdd64-3a30-4ddb-8265-94c439d5dcea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea', 'volume_size': 1} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-903156024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cccdd64-3a30-4ddb-8265-94c439d5dcea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4538392faef04bf689721b4eb91970a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:56Z,use_quota=True,user_id='f27defbc5db24b7baeb578e27328f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Creating volume 1cccdd64-3a30-4ddb-8265-94c439d5dcea {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:55 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:55 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea 1073741824 Apr 09 13:37:55 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:56 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea 1073741824" returned: 0 in 0.483s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:56 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea Apr 09 13:37:56 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:56 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea" returned: 0 in 0.415s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c11206-bc83-4b8c-829b-3c28980c7d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2c266a-413f-413d-879e-140ebafb47cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:56 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Volume volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea (1cccdd64-3a30-4ddb-8265-94c439d5dcea): created successfully Apr 09 13:37:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2c266a-413f-413d-879e-140ebafb47cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Flow 'volume_create_manager' (e771254d-9855-4a23-8f79-241e193df58d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:56 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-a88da2a0-9c00-4578-9fc7-aec819454502 tempest-VolumesListTestJSON-1231392514 None] Created volume successfully. Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Flow 'volume_create_manager' (ad0ee69c-4472-4bf5-9760-e526faf6f44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9abf52-8cca-40a7-9db3-a7fc735dfd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9abf52-8cca-40a7-9db3-a7fc735dfd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1330300478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d520a1d0-af37-4029-82fc-3e0858c0d5ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4538392faef04bf689721b4eb91970a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:58Z,use_quota=True,user_id='f27defbc5db24b7baeb578e27328f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439d06b4-aad4-4fa2-bd9f-e39d085f8743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439d06b4-aad4-4fa2-bd9f-e39d085f8743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3688f16-07b1-4a15-9462-af61c8b5e358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3688f16-07b1-4a15-9462-af61c8b5e358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd520a1d0-af37-4029-82fc-3e0858c0d5ad', 'volume_name': 'volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ece54a7-de3c-4855-8476-64095f39d755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ece54a7-de3c-4855-8476-64095f39d755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d777e6-1755-427a-a27c-5f1f410c7955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:58 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Volume d520a1d0-af37-4029-82fc-3e0858c0d5ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad', 'volume_size': 1} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1330300478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d520a1d0-af37-4029-82fc-3e0858c0d5ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4538392faef04bf689721b4eb91970a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:37:58Z,use_quota=True,user_id='f27defbc5db24b7baeb578e27328f077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Creating volume d520a1d0-af37-4029-82fc-3e0858c0d5ad {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:37:58 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:58 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad 1073741824 Apr 09 13:37:58 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:58 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad 1073741824" returned: 0 in 0.465s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:37:58 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad Apr 09 13:37:58 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:37:59 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 09 13:37:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad" returned: 0 in 0.395s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:37:59 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:37:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:37:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d777e6-1755-427a-a27c-5f1f410c7955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cad1272-f9a7-4b75-ba4c-146b8b5c1d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:37:59 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Volume volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad (d520a1d0-af37-4029-82fc-3e0858c0d5ad): created successfully Apr 09 13:37:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cad1272-f9a7-4b75-ba4c-146b8b5c1d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:37:59 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Flow 'volume_create_manager' (ad0ee69c-4472-4bf5-9760-e526faf6f44b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:37:59 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-a78fb589-4dbc-4833-b7dd-2a7748844427 tempest-VolumesListTestJSON-1231392514 None] Created volume successfully. Apr 09 13:38:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "cinder-d520a1d0-af37-4029-82fc-3e0858c0d5ad-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-d520a1d0-af37-4029-82fc-3e0858c0d5ad-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "cinder-quobyte-d520a1d0-af37-4029-82fc-3e0858c0d5ad" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-quobyte-d520a1d0-af37-4029-82fc-3e0858c0d5ad" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:01 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[296f7d6a-3d5c-4771-86dd-d3943637c3a4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:01 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad Apr 09 13:38:01 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:01 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad" returned: 0 in 0.445s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:01 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad Apr 09 13:38:01 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:02 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d520a1d0-af37-4029-82fc-3e0858c0d5ad" returned: 0 in 0.400s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-quobyte-d520a1d0-af37-4029-82fc-3e0858c0d5ad" released by "delete_volume" :: held 0.869s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Created reservations ['c3272d51-b7ce-4ca2-9517-5294ba35e3d0', 'a863a8dd-7283-48c0-b8fc-85e4a8deed49', 'a1b07b45-d659-4b78-86c6-dbfc0aa7539d', '68108b04-f8c3-40ac-b06f-9c917923ba87'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:02 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:02 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "cinder-1cccdd64-3a30-4ddb-8265-94c439d5dcea-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-1cccdd64-3a30-4ddb-8265-94c439d5dcea-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "cinder-quobyte-1cccdd64-3a30-4ddb-8265-94c439d5dcea" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-quobyte-1cccdd64-3a30-4ddb-8265-94c439d5dcea" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[080904e4-54f7-4c17-9d33-6cad7e03b3a4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:02 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea Apr 09 13:38:02 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:02 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.445s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:02 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Deleted volume successfully. Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fc5395d2-9fc0-4302-968d-f4ce3db00dd4 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-d520a1d0-af37-4029-82fc-3e0858c0d5ad-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:02 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea" returned: 0 in 0.471s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:02 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea Apr 09 13:38:02 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:03 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1cccdd64-3a30-4ddb-8265-94c439d5dcea" returned: 0 in 0.412s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-quobyte-1cccdd64-3a30-4ddb-8265-94c439d5dcea" released by "delete_volume" :: held 0.904s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Created reservations ['e9c9dfd6-7dbb-4741-92c5-292713c96496', 'e00d432d-33f8-4581-b89b-f6f892b689c1', '9f6c33ce-3723-41ed-9af8-9f175b1fb504', 'f73ef186-4196-4fc8-9040-ccc68fbe0730'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:03 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:03 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "cinder-f75be4a8-cae0-4262-9e5d-c604c3a59c10-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-f75be4a8-cae0-4262-9e5d-c604c3a59c10-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "cinder-quobyte-f75be4a8-cae0-4262-9e5d-c604c3a59c10" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-quobyte-f75be4a8-cae0-4262-9e5d-c604c3a59c10" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0545fb72-9908-4bd2-9d2e-6670ed10b06c]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:03 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10 Apr 09 13:38:03 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:03 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.435s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:03 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Deleted volume successfully. Apr 09 13:38:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ac1cd9f6-23d9-4358-9d91-7e74248e0155 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-1cccdd64-3a30-4ddb-8265-94c439d5dcea-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:04 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10" returned: 0 in 0.485s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:04 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10 Apr 09 13:38:04 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:04 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f75be4a8-cae0-4262-9e5d-c604c3a59c10" returned: 0 in 0.423s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-quobyte-f75be4a8-cae0-4262-9e5d-c604c3a59c10" released by "delete_volume" :: held 0.940s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Created reservations ['0656ef22-3ec6-4972-aee7-84b396562afe', '20229003-2a2f-4b48-91fa-2a8e681bad05', '1ec1b516-9f56-4356-b858-9f43e35e5c50', 'dc0da67f-6ae9-4f4d-9e94-ff70fea71d45'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:04 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:04 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:04 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.471s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:04 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:05 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Deleted volume successfully. Apr 09 13:38:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8579329d-56e0-42fb-b955-83d60f1a6d50 tempest-VolumesListTestJSON-1231392514 None] Lock "cinder-f75be4a8-cae0-4262-9e5d-c604c3a59c10-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Flow 'volume_create_manager' (726a79b4-db0d-46ab-9692-30e99885a961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07475a6f-f70a-47f0-8545-26fc16a02d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07475a6f-f70a-47f0-8545-26fc16a02d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1858356751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6567e218-9242-49f7-9b7a-e2ee09dc1499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a896b5cd8c4b23ab7eedf775617c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:06Z,use_quota=True,user_id='7401d7d0c96944ddabc5fb94f5090ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84e11ce-48f2-44c9-b80e-89db8a9c8a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84e11ce-48f2-44c9-b80e-89db8a9c8a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f90c472-140a-4665-911d-dcbdddb85139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f90c472-140a-4665-911d-dcbdddb85139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6567e218-9242-49f7-9b7a-e2ee09dc1499', 'volume_name': 'volume-6567e218-9242-49f7-9b7a-e2ee09dc1499', 'volume_size': 2}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc5a69a-5566-4bc2-84a7-2b4ed8537d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc5a69a-5566-4bc2-84a7-2b4ed8537d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39254679-6241-4fb8-bbee-b429b7875e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:06 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Volume 6567e218-9242-49f7-9b7a-e2ee09dc1499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6567e218-9242-49f7-9b7a-e2ee09dc1499', 'volume_size': 2} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1858356751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6567e218-9242-49f7-9b7a-e2ee09dc1499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a896b5cd8c4b23ab7eedf775617c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:06Z,use_quota=True,user_id='7401d7d0c96944ddabc5fb94f5090ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Creating volume 6567e218-9242-49f7-9b7a-e2ee09dc1499 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:06 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 2147483648 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:06 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 2147483648 Apr 09 13:38:06 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:07 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 2147483648" returned: 0 in 0.483s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:07 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 Apr 09 13:38:07 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:07 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499" returned: 0 in 0.423s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39254679-6241-4fb8-bbee-b429b7875e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6567e218-9242-49f7-9b7a-e2ee09dc1499', 'volume_size': 2}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff4a3de-c4b1-49eb-8cd8-5ef258713ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:07 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Volume volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 (6567e218-9242-49f7-9b7a-e2ee09dc1499): created successfully Apr 09 13:38:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff4a3de-c4b1-49eb-8cd8-5ef258713ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:07 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Flow 'volume_create_manager' (726a79b4-db0d-46ab-9692-30e99885a961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:07 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-cdfb2a13-35be-495d-8c97-445a0735a53b tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Created volume successfully. Apr 09 13:38:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:08 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Creating offline snapshot 66e012b0-a8cf-4d5b-a708-904c90bfe0ec of volume 6567e218-9242-49f7-9b7a-e2ee09dc1499 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:38:08 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[efce6663-3112-400c-9d7b-300a9f7f6d79]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:08 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 Apr 09 13:38:08 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:09 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499" returned: 0 in 0.465s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec 2G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:09 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec 2G Apr 09 13:38:09 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:09 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec 2G" returned: 0 in 0.459s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:09 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec Apr 09 13:38:09 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:10 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec" returned: 0 in 0.410s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:10 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec is being set with open permissions: ugo+rw Apr 09 13:38:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:10 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec Apr 09 13:38:10 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:10 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec" returned: 0 in 0.392s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:10 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.info Apr 09 13:38:10 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:10 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.info" returned: 0 in 0.409s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:10 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.info is being set with open permissions: ugo+rw Apr 09 13:38:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:10 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.info Apr 09 13:38:10 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:11 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.info" returned: 0 in 0.392s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:11 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-bf951b4f-a89a-4ac8-b540-ea6db2daf379 tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Create snapshot completed successfully Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Acquiring lock "cinder-66e012b0-a8cf-4d5b-a708-904c90bfe0ec-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "cinder-66e012b0-a8cf-4d5b-a708-904c90bfe0ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Acquiring lock "cinder-quobyte-6567e218-9242-49f7-9b7a-e2ee09dc1499" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "cinder-quobyte-6567e218-9242-49f7-9b7a-e2ee09dc1499" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Acquiring lock "cinder-quobyte-66e012b0-a8cf-4d5b-a708-904c90bfe0ec" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "cinder-quobyte-66e012b0-a8cf-4d5b-a708-904c90bfe0ec" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Deleting offline snapshot 66e012b0-a8cf-4d5b-a708-904c90bfe0ec of volume 6567e218-9242-49f7-9b7a-e2ee09dc1499 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] snapshot_file for this snap is: volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abca0d4-aea3-47dc-9c7b-88745c2a9005]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:11 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec Apr 09 13:38:11 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:12 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec" returned: 0 in 0.457s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6567e218-9242-49f7-9b7a-e2ee09dc1499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:38:12 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d017da42-7a1f-4d9e-8fbb-de50f4d63fe5]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:12 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 Apr 09 13:38:12 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:12 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499" returned: 0 in 0.451s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:12 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec Apr 09 13:38:12 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:13 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec" returned: 0 in 0.436s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:13 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec Apr 09 13:38:13 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:13 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499.66e012b0-a8cf-4d5b-a708-904c90bfe0ec" returned: 0 in 0.411s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "cinder-quobyte-66e012b0-a8cf-4d5b-a708-904c90bfe0ec" released by "_delete_snapshot" :: held 1.805s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "cinder-quobyte-6567e218-9242-49f7-9b7a-e2ee09dc1499" released by "delete_snapshot" :: held 1.818s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:13 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Created reservations ['8dba3096-e248-4e21-8431-2b052b4e6145', '1512023d-0328-49e3-b308-d978befdec27', '3d61d182-4477-4082-8652-4004ab9cf78b', 'c5a3d6b8-1d56-4fcd-9702-88d466f4c0ce'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:13 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Delete snapshot completed successfully. Apr 09 13:38:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f5ec4fff-5bc5-417b-aada-c60e29c1dfaf tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "cinder-66e012b0-a8cf-4d5b-a708-904c90bfe0ec-delete_snapshot" released by "delete_snapshot" :: held 1.891s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Acquiring lock "cinder-6567e218-9242-49f7-9b7a-e2ee09dc1499-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "cinder-6567e218-9242-49f7-9b7a-e2ee09dc1499-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Acquiring lock "cinder-quobyte-6567e218-9242-49f7-9b7a-e2ee09dc1499" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "cinder-quobyte-6567e218-9242-49f7-9b7a-e2ee09dc1499" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f01895a-f481-4e23-8b6a-7bb9220d3be4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:14 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 Apr 09 13:38:14 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:14 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499" returned: 0 in 0.450s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:14 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499 Apr 09 13:38:14 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:14 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6567e218-9242-49f7-9b7a-e2ee09dc1499" returned: 0 in 0.422s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "cinder-quobyte-6567e218-9242-49f7-9b7a-e2ee09dc1499" released by "delete_volume" :: held 0.904s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Created reservations ['b80c7790-ce9e-4e2e-8b7f-786a4cd47d44', '665eb0a4-74a0-4ca8-9aef-6f4e0f94e52c', '622ba95f-2cf8-4f66-9d54-dcaf97054f1f', '08c910a2-da86-402e-b84f-320f7082f398'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:15 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:15 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:15 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.414s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:15 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:15 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Deleted volume successfully. Apr 09 13:38:15 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-246bf40f-5edf-4a9c-a6e3-6432fde5d3ec tempest-VolumesSnapshotNegativeTestJSON-1267913166 None] Lock "cinder-6567e218-9242-49f7-9b7a-e2ee09dc1499-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (6050e262-f6de-46b4-b11e-c77c60194c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43416405-e510-40b4-8e3f-1afe5820646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43416405-e510-40b4-8e3f-1afe5820646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-154142653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff7877f-e8dd-41bf-9a89-41df42158e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:17Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29dbfcc-b13c-441b-9ec0-e0e2c54414df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29dbfcc-b13c-441b-9ec0-e0e2c54414df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870b8368-fca8-4768-b7eb-3eb0c8ee4ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870b8368-fca8-4768-b7eb-3eb0c8ee4ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bff7877f-e8dd-41bf-9a89-41df42158e5b', 'volume_name': 'volume-bff7877f-e8dd-41bf-9a89-41df42158e5b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537907a7-b745-47fb-a8e2-e2dbbc17de47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537907a7-b745-47fb-a8e2-e2dbbc17de47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32025681-fd1c-47f0-8409-2a98aa2e0da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:16 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume bff7877f-e8dd-41bf-9a89-41df42158e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bff7877f-e8dd-41bf-9a89-41df42158e5b', 'volume_size': 1} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-154142653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff7877f-e8dd-41bf-9a89-41df42158e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:17Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Creating volume bff7877f-e8dd-41bf-9a89-41df42158e5b {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:16 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:16 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b 1073741824 Apr 09 13:38:16 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:17 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b 1073741824" returned: 0 in 0.485s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:17 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b Apr 09 13:38:17 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:17 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b" returned: 0 in 0.391s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32025681-fd1c-47f0-8409-2a98aa2e0da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff7877f-e8dd-41bf-9a89-41df42158e5b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f759471-eed2-4d1e-b0d5-73e7f99a36e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:17 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume volume-bff7877f-e8dd-41bf-9a89-41df42158e5b (bff7877f-e8dd-41bf-9a89-41df42158e5b): created successfully Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f759471-eed2-4d1e-b0d5-73e7f99a36e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (6050e262-f6de-46b4-b11e-c77c60194c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:17 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-0818f4ab-1fd2-4a48-aefb-355a7cf01cac tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created volume successfully. Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (0d79209b-10dc-47e8-bd0b-f0c6ec8499bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ad630b-ca38-4868-840a-2f16481dc9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ad630b-ca38-4868-840a-2f16481dc9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-965550431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b344f937-0d30-4aa0-a1b8-9b21808e7f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:18Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41840f6-46f8-41ed-9eea-4752d44492cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41840f6-46f8-41ed-9eea-4752d44492cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5c8c26-1bbc-451f-a6ac-48b46545d3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5c8c26-1bbc-451f-a6ac-48b46545d3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b344f937-0d30-4aa0-a1b8-9b21808e7f84', 'volume_name': 'volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6d8aeb-3fef-45ab-b7d0-b19af0a9e636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:17 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6d8aeb-3fef-45ab-b7d0-b19af0a9e636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39870659-dc76-4df9-8f6e-e09ead71bec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume b344f937-0d30-4aa0-a1b8-9b21808e7f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84', 'volume_size': 1} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-965550431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b344f937-0d30-4aa0-a1b8-9b21808e7f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:18Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Creating volume b344f937-0d30-4aa0-a1b8-9b21808e7f84 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:18 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:18 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84 1073741824 Apr 09 13:38:18 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (f914af92-f928-4521-87d3-6489b97965b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc534838-6d58-4435-b18f-ee55e60aab8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc534838-6d58-4435-b18f-ee55e60aab8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-422782368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a416745-ac9f-4a1b-84b9-d6b70a0cf94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:18Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a10eb0-121f-4272-b95f-a019e9b95153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a10eb0-121f-4272-b95f-a019e9b95153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca23acb-ebf4-46f1-843f-804e9970cd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca23acb-ebf4-46f1-843f-804e9970cd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a416745-ac9f-4a1b-84b9-d6b70a0cf94b', 'volume_name': 'volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de95fa03-3739-44bf-be84-3f8b40b9779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de95fa03-3739-44bf-be84-3f8b40b9779b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a9f3c8-c8d6-482f-89c3-545dded6287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume 6a416745-ac9f-4a1b-84b9-d6b70a0cf94b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b', 'volume_size': 1} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (170c9045-6352-4530-883d-4b700b411563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59199fd3-5840-4564-8f8e-bc43c405ee2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59199fd3-5840-4564-8f8e-bc43c405ee2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-720057252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615b917d-2909-4b72-b183-4c63267eda3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:18Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23e4727-45e2-492a-a968-ea81dd4ba9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23e4727-45e2-492a-a968-ea81dd4ba9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e068c5-0eb8-4b70-bf61-c00e30be789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e068c5-0eb8-4b70-bf61-c00e30be789e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '615b917d-2909-4b72-b183-4c63267eda3e', 'volume_name': 'volume-615b917d-2909-4b72-b183-4c63267eda3e', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cbf6c6-4371-49be-9c20-216c1834416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cbf6c6-4371-49be-9c20-216c1834416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314bd125-6ef5-4e95-af7d-1a9390e1bc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume 615b917d-2909-4b72-b183-4c63267eda3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-615b917d-2909-4b72-b183-4c63267eda3e', 'volume_size': 1} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (c370c230-6ebc-4210-922e-dc63000f8226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9b5559-03a5-4b59-bd24-01b6f7b08349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84 1073741824" returned: 0 in 0.578s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9b5559-03a5-4b59-bd24-01b6f7b08349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1475695579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9deb28-0152-4da8-947f-20c565a292c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:19Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0acf32-3ab7-4784-8e88-690e48c1e42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0acf32-3ab7-4784-8e88-690e48c1e42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1af9b5-c345-4308-bd76-965b19cab245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1af9b5-c345-4308-bd76-965b19cab245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9deb28-0152-4da8-947f-20c565a292c6', 'volume_name': 'volume-bd9deb28-0152-4da8-947f-20c565a292c6', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f897cb1-b14b-4b46-93d8-016a90351918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f897cb1-b14b-4b46-93d8-016a90351918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb4d065-2bc4-42fa-980f-337a42ebc6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume bd9deb28-0152-4da8-947f-20c565a292c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9deb28-0152-4da8-947f-20c565a292c6', 'volume_size': 1} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:18 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84 Apr 09 13:38:18 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (03e47928-80ac-4610-9c9f-eed0ece45e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6751278e-e37e-433e-82f8-a5989a9cdc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6751278e-e37e-433e-82f8-a5989a9cdc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794523288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1590c9c-6092-4377-bf87-5da725e64134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:19Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d865c18-b07e-48e1-97c3-fe7ddbbd8477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d865c18-b07e-48e1-97c3-fe7ddbbd8477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2021d3d-cce9-4332-8be1-c22532703824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2021d3d-cce9-4332-8be1-c22532703824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1590c9c-6092-4377-bf87-5da725e64134', 'volume_name': 'volume-c1590c9c-6092-4377-bf87-5da725e64134', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5c6ab3-ff67-4179-8647-b0714e02da1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5c6ab3-ff67-4179-8647-b0714e02da1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962bd769-8a23-4845-b913-c52efcdbb677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:18 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume c1590c9c-6092-4377-bf87-5da725e64134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1590c9c-6092-4377-bf87-5da725e64134', 'volume_size': 1} Apr 09 13:38:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:19 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84" returned: 0 in 0.421s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-422782368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a416745-ac9f-4a1b-84b9-d6b70a0cf94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:18Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Creating volume 6a416745-ac9f-4a1b-84b9-d6b70a0cf94b {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:19 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39870659-dc76-4df9-8f6e-e09ead71bec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de4ab8c-a6d4-48b6-9022-b23c7a6e2e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:19 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b 1073741824 Apr 09 13:38:19 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:19 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84 (b344f937-0d30-4aa0-a1b8-9b21808e7f84): created successfully Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de4ab8c-a6d4-48b6-9022-b23c7a6e2e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (0d79209b-10dc-47e8-bd0b-f0c6ec8499bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:19 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-85c619a9-d8eb-447d-b8dd-a8dc55296955 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created volume successfully. Apr 09 13:38:19 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b 1073741824" returned: 0 in 0.458s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:19 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b Apr 09 13:38:19 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:19 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b" returned: 0 in 0.415s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.566s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-720057252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615b917d-2909-4b72-b183-4c63267eda3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:18Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Creating volume 615b917d-2909-4b72-b183-4c63267eda3e {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:19 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a9f3c8-c8d6-482f-89c3-545dded6287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:20 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e 1073741824 Apr 09 13:38:20 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5be441-e764-46b4-a0ba-8b2653a367ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b (6a416745-ac9f-4a1b-84b9-d6b70a0cf94b): created successfully Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5be441-e764-46b4-a0ba-8b2653a367ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (f914af92-f928-4521-87d3-6489b97965b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:20 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-aff617e7-6714-4699-af04-7763a3af1e01 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created volume successfully. Apr 09 13:38:20 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e 1073741824" returned: 0 in 0.466s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:20 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e Apr 09 13:38:20 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:20 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e" returned: 0 in 0.398s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.249s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1475695579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9deb28-0152-4da8-947f-20c565a292c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:19Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Creating volume bd9deb28-0152-4da8-947f-20c565a292c6 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:20 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314bd125-6ef5-4e95-af7d-1a9390e1bc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-615b917d-2909-4b72-b183-4c63267eda3e', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:20 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6 1073741824 Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60e4512-3722-4a55-8b9a-a8dfa1bbe255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:20 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume volume-615b917d-2909-4b72-b183-4c63267eda3e (615b917d-2909-4b72-b183-4c63267eda3e): created successfully Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b60e4512-3722-4a55-8b9a-a8dfa1bbe255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (170c9045-6352-4530-883d-4b700b411563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:20 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6380c012-26d3-462c-8e1e-4f9e4d807eb4 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created volume successfully. Apr 09 13:38:21 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6 1073741824" returned: 0 in 0.483s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:21 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6 Apr 09 13:38:21 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:21 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6" returned: 0 in 0.395s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.980s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794523288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1590c9c-6092-4377-bf87-5da725e64134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d6e6094852049dca4b665cc1c2ee782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:19Z,use_quota=True,user_id='529ecd1aea3349458683f09b6f6cee1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Creating volume c1590c9c-6092-4377-bf87-5da725e64134 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:21 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb4d065-2bc4-42fa-980f-337a42ebc6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9deb28-0152-4da8-947f-20c565a292c6', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:21 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134 1073741824 Apr 09 13:38:21 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798ad21d-32da-405e-8268-22ea3bbbf96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:21 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume volume-bd9deb28-0152-4da8-947f-20c565a292c6 (bd9deb28-0152-4da8-947f-20c565a292c6): created successfully Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798ad21d-32da-405e-8268-22ea3bbbf96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (c370c230-6ebc-4210-922e-dc63000f8226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:21 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-466b592b-a62d-44cc-88d6-b4f34035447b tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created volume successfully. Apr 09 13:38:22 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134 1073741824" returned: 0 in 0.490s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:22 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134 Apr 09 13:38:22 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:22 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134" returned: 0 in 0.427s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962bd769-8a23-4845-b913-c52efcdbb677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1590c9c-6092-4377-bf87-5da725e64134', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2345d8b-d73b-4933-9a7b-6111bbd17c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:22 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Volume volume-c1590c9c-6092-4377-bf87-5da725e64134 (c1590c9c-6092-4377-bf87-5da725e64134): created successfully Apr 09 13:38:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2345d8b-d73b-4933-9a7b-6111bbd17c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Flow 'volume_create_manager' (03e47928-80ac-4610-9c9f-eed0ece45e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:22 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2341245a-2bad-4ed7-9cc7-a51af4dd96ff tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created volume successfully. Apr 09 13:38:23 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-c1590c9c-6092-4377-bf87-5da725e64134-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:23 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-c1590c9c-6092-4377-bf87-5da725e64134-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:23 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-quobyte-c1590c9c-6092-4377-bf87-5da725e64134" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:23 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-c1590c9c-6092-4377-bf87-5da725e64134" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:23 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9fd667-5def-4195-a42d-7f8d828312fd]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:23 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134 Apr 09 13:38:23 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:23 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134" returned: 0 in 0.490s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:23 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134 Apr 09 13:38:23 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:24 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-c1590c9c-6092-4377-bf87-5da725e64134" returned: 0 in 0.416s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-c1590c9c-6092-4377-bf87-5da725e64134" released by "delete_volume" :: held 0.928s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created reservations ['cce1117d-d113-4184-b48e-78c80e5ef331', '1434271f-beed-4e64-bc26-e902da3b59d5', '2ce2c5ba-c18b-4d66-b0ae-0386d8f7bd4b', 'fe637e20-eff4-47b2-9534-b9e11dee2bd8'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:24 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:24 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-bd9deb28-0152-4da8-947f-20c565a292c6-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-bd9deb28-0152-4da8-947f-20c565a292c6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-quobyte-bd9deb28-0152-4da8-947f-20c565a292c6" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-bd9deb28-0152-4da8-947f-20c565a292c6" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[5440b3ea-f08b-47ef-9126-37930a20e12e]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:24 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6 Apr 09 13:38:24 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:24 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.404s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:24 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Deleted volume successfully. Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b0b3cf8c-6ec1-4367-8274-316bdaf342eb tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-c1590c9c-6092-4377-bf87-5da725e64134-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:24 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6" returned: 0 in 0.467s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:24 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6 Apr 09 13:38:24 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:25 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bd9deb28-0152-4da8-947f-20c565a292c6" returned: 0 in 0.410s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-bd9deb28-0152-4da8-947f-20c565a292c6" released by "delete_volume" :: held 0.898s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created reservations ['9edd8c72-1ebf-4b38-81fb-1032b962e1be', '840bd9f0-9002-4ff8-8e54-959dda0594ee', 'eee88131-0ca1-457e-a532-876c7f386b51', '94a16015-4404-4826-8d2e-6f8bd2f75d9b'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:25 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:25 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-615b917d-2909-4b72-b183-4c63267eda3e-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-615b917d-2909-4b72-b183-4c63267eda3e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-quobyte-615b917d-2909-4b72-b183-4c63267eda3e" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-615b917d-2909-4b72-b183-4c63267eda3e" acquired by "delete_volume" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff78bab-f231-4cdf-8a4e-ecaf20f55358]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:25 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e Apr 09 13:38:25 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:25 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.403s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:25 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Deleted volume successfully. Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e10dbf47-d571-4f62-9c5b-bada9bf1d23e tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-bd9deb28-0152-4da8-947f-20c565a292c6-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:25 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e" returned: 0 in 0.470s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:25 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e Apr 09 13:38:25 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:26 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-615b917d-2909-4b72-b183-4c63267eda3e" returned: 0 in 0.395s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-615b917d-2909-4b72-b183-4c63267eda3e" released by "delete_volume" :: held 0.887s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created reservations ['afd48cd3-d661-4acb-b004-f7b2802a9213', 'f3de7a47-5a0e-4e58-835d-bcc2f9e4254e', '56b6d590-3e6a-46ef-8e11-26e3ad0898e4', '4960284e-3b6c-403a-abb1-5cd02d857142'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:26 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:26 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-quobyte-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ea8136-68de-4ad6-9e8a-64abbe7bf8c2]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:26 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b Apr 09 13:38:26 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:26 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.455s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:26 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Deleted volume successfully. Apr 09 13:38:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-8088b8fc-d0d7-4d24-b810-86882889b394 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-615b917d-2909-4b72-b183-4c63267eda3e-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:27 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b" returned: 0 in 0.492s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:27 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b Apr 09 13:38:27 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:27 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b" returned: 0 in 0.458s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b" released by "delete_volume" :: held 0.978s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created reservations ['8dbaea27-e07a-4948-9eab-d49f6ee9fd85', '1f1b4be3-e6c1-4779-938f-e7b0867ded7b', '631d891e-a61f-42d9-be05-b18f5f054617', '7793c7b7-479c-45ac-835d-8a6baa79fe1d'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:27 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:27 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-b344f937-0d30-4aa0-a1b8-9b21808e7f84-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-b344f937-0d30-4aa0-a1b8-9b21808e7f84-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-quobyte-b344f937-0d30-4aa0-a1b8-9b21808e7f84" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-b344f937-0d30-4aa0-a1b8-9b21808e7f84" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9434e06-c502-443c-929d-a6b5e45f88ef]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:27 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84 Apr 09 13:38:27 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:28 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.442s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:28 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Deleted volume successfully. Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-57ce83bb-494a-4bf9-8516-c5e7369db351 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-6a416745-ac9f-4a1b-84b9-d6b70a0cf94b-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:28 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84" returned: 0 in 0.483s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:28 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84 Apr 09 13:38:28 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:28 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b344f937-0d30-4aa0-a1b8-9b21808e7f84" returned: 0 in 0.403s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-b344f937-0d30-4aa0-a1b8-9b21808e7f84" released by "delete_volume" :: held 0.909s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created reservations ['fbfaf1fb-d44d-4abf-bfd8-1cd3e772e27f', '1a484529-a849-4540-bede-0612f175a85b', '18206d1b-ff64-4eb3-9d37-7404072312f0', 'ef772563-1d98-4712-84a4-a77dd0aa6e5c'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:28 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:28 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-bff7877f-e8dd-41bf-9a89-41df42158e5b-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-bff7877f-e8dd-41bf-9a89-41df42158e5b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "cinder-quobyte-bff7877f-e8dd-41bf-9a89-41df42158e5b" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-bff7877f-e8dd-41bf-9a89-41df42158e5b" acquired by "delete_volume" :: waited 0.006s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24d6e32-d476-4bc8-843c-f12a0aeeec2f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:28 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b Apr 09 13:38:28 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:29 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.436s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:29 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Deleted volume successfully. Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-97e88b67-6937-4a00-9015-ad4bbb4144f6 tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-b344f937-0d30-4aa0-a1b8-9b21808e7f84-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:29 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b" returned: 0 in 0.504s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:29 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b Apr 09 13:38:29 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:29 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-bff7877f-e8dd-41bf-9a89-41df42158e5b" returned: 0 in 0.407s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-quobyte-bff7877f-e8dd-41bf-9a89-41df42158e5b" released by "delete_volume" :: held 0.933s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Created reservations ['29d7ca7f-2787-4437-b31e-2ff4297c6408', '6d5e2107-6136-464b-8bb8-fd1d52711cba', 'e2d20945-6191-4699-977f-668b402a98cf', '48ca1c0a-7de1-4e4a-8c93-4a09250edce7'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:29 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:29 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:30 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.466s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:30 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:30 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Deleted volume successfully. Apr 09 13:38:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2d65527f-2846-472e-8b81-afe4b9a4d63f tempest-CreateVolumesFromSourceVolumeTest-1047879160 None] Lock "cinder-bff7877f-e8dd-41bf-9a89-41df42158e5b-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Flow 'volume_create_manager' (4dcbf836-3575-4471-a799-47a3ca001584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fb52e7-1f22-4450-a44a-89cc13ac54db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94fb52e7-1f22-4450-a44a-89cc13ac54db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e935aadfe9e742cd9b5ad6429938145b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:32Z,use_quota=True,user_id='bda24b52eef9492fadcbbe89a0540673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b41de7-738c-4368-b3ea-378422d32f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b41de7-738c-4368-b3ea-378422d32f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939f16a8-8942-452b-9067-0407d963d367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939f16a8-8942-452b-9067-0407d963d367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b', 'volume_name': 'volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6ddba2-a116-4b1d-8caa-8582e5648fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6ddba2-a116-4b1d-8caa-8582e5648fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4d3e2a-b370-4879-8267-5d0f468e1b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:31 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Volume f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b', 'volume_size': 1} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e935aadfe9e742cd9b5ad6429938145b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:32Z,use_quota=True,user_id='bda24b52eef9492fadcbbe89a0540673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Creating volume f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:31 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:31 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b 1073741824 Apr 09 13:38:31 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:32 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b 1073741824" returned: 0 in 0.466s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:32 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:UPDATE=154,cinder:SELECT=116,cinder:INSERT=44,cinder:DELETE=14 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:38:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:32 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b Apr 09 13:38:32 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:32 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b" returned: 0 in 0.400s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4d3e2a-b370-4879-8267-5d0f468e1b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4460ce16-6177-4989-b1a9-4b30f915ba79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:32 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Volume volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b (f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b): created successfully Apr 09 13:38:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4460ce16-6177-4989-b1a9-4b30f915ba79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:32 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Flow 'volume_create_manager' (4dcbf836-3575-4471-a799-47a3ca001584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:32 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f247b1bd-bd05-49cd-9024-261998d528cb tempest-CinderUnicodeTest-1345968867 None] Created volume successfully. Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG oslo_service.periodic_task [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82346) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:33 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:33 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:33 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.461s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4a388961-8acb-4d39-ba06-c1328a44b660 None None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:UPDATE=192,cinder:SELECT=127,cinder:INSERT=49,cinder:DELETE=16 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Flow 'volume_create_manager' (9c042ed2-4559-41f8-afcd-483194ea606a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dce9e0-2e85-4896-96f1-93a3e0a641bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dce9e0-2e85-4896-96f1-93a3e0a641bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-433307984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd587ab-8b17-42fc-a168-9556ebfe1d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e935aadfe9e742cd9b5ad6429938145b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:34Z,use_quota=True,user_id='bda24b52eef9492fadcbbe89a0540673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4b94b7-35d4-4058-b6b1-7a7b62685518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4b94b7-35d4-4058-b6b1-7a7b62685518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4028962-8cf4-4bc2-9452-dde004eb18c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4028962-8cf4-4bc2-9452-dde004eb18c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd587ab-8b17-42fc-a168-9556ebfe1d0a', 'volume_name': 'volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb2a334-8364-470a-a4e7-59fa57cc0a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb2a334-8364-470a-a4e7-59fa57cc0a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1190e53-2ce9-4f14-bb8f-546f458ce45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:33 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Volume fdd587ab-8b17-42fc-a168-9556ebfe1d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a', 'volume_size': 1} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-433307984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd587ab-8b17-42fc-a168-9556ebfe1d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e935aadfe9e742cd9b5ad6429938145b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:34Z,use_quota=True,user_id='bda24b52eef9492fadcbbe89a0540673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Creating volume fdd587ab-8b17-42fc-a168-9556ebfe1d0a {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:34 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:34 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a 1073741824 Apr 09 13:38:34 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:34 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a 1073741824" returned: 0 in 0.518s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:34 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a Apr 09 13:38:34 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:34 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a" returned: 0 in 0.409s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1190e53-2ce9-4f14-bb8f-546f458ce45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1a1450-5606-4e7f-abac-ac04c5a8c0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:34 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Volume volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a (fdd587ab-8b17-42fc-a168-9556ebfe1d0a): created successfully Apr 09 13:38:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1a1450-5606-4e7f-abac-ac04c5a8c0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:34 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Flow 'volume_create_manager' (9c042ed2-4559-41f8-afcd-483194ea606a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:34 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d0d9c622-5ed4-414e-9161-2b80ac743fee tempest-CinderUnicodeTest-1345968867 None] Created volume successfully. Apr 09 13:38:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:36 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] Creating offline snapshot d07b2533-f2ec-4009-91a5-000940f5a91c of volume fdd587ab-8b17-42fc-a168-9556ebfe1d0a {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:38:36 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0bec30-e603-4315-9a6a-1e516a7bb821]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:36 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a Apr 09 13:38:36 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:36 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a" returned: 0 in 0.466s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:36 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c 1G Apr 09 13:38:36 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:37 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c 1G" returned: 0 in 0.514s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:37 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c Apr 09 13:38:37 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:37 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c" returned: 0 in 0.443s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:37 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c is being set with open permissions: ugo+rw Apr 09 13:38:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:37 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c Apr 09 13:38:37 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:38 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c" returned: 0 in 0.447s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:38 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.info Apr 09 13:38:38 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:38 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.info" returned: 0 in 0.432s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:38 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.info is being set with open permissions: ugo+rw Apr 09 13:38:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:38 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.info Apr 09 13:38:38 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:38 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.info" returned: 0 in 0.412s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.772s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:39 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-9fae0123-65be-41b1-a849-6018a11698bf tempest-CinderUnicodeTest-1345968867 None] Create snapshot completed successfully Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "cinder-d07b2533-f2ec-4009-91a5-000940f5a91c-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-d07b2533-f2ec-4009-91a5-000940f5a91c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "cinder-quobyte-fdd587ab-8b17-42fc-a168-9556ebfe1d0a" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-quobyte-fdd587ab-8b17-42fc-a168-9556ebfe1d0a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "cinder-quobyte-d07b2533-f2ec-4009-91a5-000940f5a91c" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-quobyte-d07b2533-f2ec-4009-91a5-000940f5a91c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Deleting offline snapshot d07b2533-f2ec-4009-91a5-000940f5a91c of volume fdd587ab-8b17-42fc-a168-9556ebfe1d0a {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] snapshot_file for this snap is: volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb7404b-3dc6-4fe3-8c7b-2d72682b520f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:39 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c Apr 09 13:38:39 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:39 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c" returned: 0 in 0.474s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d403f715-f293-42ea-a4aa-e75d7fd4cafe]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:39 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a Apr 09 13:38:39 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:40 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a" returned: 0 in 0.487s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:40 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c Apr 09 13:38:40 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:40 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c" returned: 0 in 0.457s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:40 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c Apr 09 13:38:40 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:41 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a.d07b2533-f2ec-4009-91a5-000940f5a91c" returned: 0 in 0.399s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-quobyte-d07b2533-f2ec-4009-91a5-000940f5a91c" released by "_delete_snapshot" :: held 1.877s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-quobyte-fdd587ab-8b17-42fc-a168-9556ebfe1d0a" released by "delete_snapshot" :: held 1.890s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Created reservations ['8448e1f3-c565-466b-9f21-1705897c6e5d', 'b9dc32e6-68b7-422c-bece-8ab93c3bb937', '9246bf7f-86f3-420e-824a-876e6ca311d1', 'fb7ae086-2132-47df-b38d-ee992650bd43'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:41 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Delete snapshot completed successfully. Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ede9aa71-7ead-47a6-b570-6f108e563c4b tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-d07b2533-f2ec-4009-91a5-000940f5a91c-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "cinder-fdd587ab-8b17-42fc-a168-9556ebfe1d0a-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-fdd587ab-8b17-42fc-a168-9556ebfe1d0a-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "cinder-quobyte-fdd587ab-8b17-42fc-a168-9556ebfe1d0a" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-quobyte-fdd587ab-8b17-42fc-a168-9556ebfe1d0a" acquired by "delete_volume" :: waited 0.006s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c42fe8-8f8d-454a-9ff7-6305abefc1bf]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:41 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a Apr 09 13:38:41 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:41 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a" returned: 0 in 0.453s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:41 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a Apr 09 13:38:42 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:42 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fdd587ab-8b17-42fc-a168-9556ebfe1d0a" returned: 0 in 0.382s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-quobyte-fdd587ab-8b17-42fc-a168-9556ebfe1d0a" released by "delete_volume" :: held 0.870s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Created reservations ['ae99ae11-6efa-4c88-9e96-92fd2cf4e8c6', 'add86e4f-72c4-4678-ab54-f5f2d84d85c5', 'd46b555f-8c7d-4279-b1dd-c0a57da6248f', 'e7e9592e-4521-4a52-84ef-eb92c3f03e12'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:42 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:42 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "cinder-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "cinder-quobyte-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-quobyte-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae78eb5-fec1-4f40-94b8-a4f67746971f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:42 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b Apr 09 13:38:42 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:42 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.410s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:42 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Deleted volume successfully. Apr 09 13:38:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0a4801a9-0bcd-4a12-bd43-875b05978602 tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-fdd587ab-8b17-42fc-a168-9556ebfe1d0a-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:43 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b" returned: 0 in 0.476s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:43 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b Apr 09 13:38:43 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:43 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b" returned: 0 in 0.387s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-quobyte-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b" released by "delete_volume" :: held 0.884s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:43 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Created reservations ['71b483fb-1175-4d54-bbdd-7d090361b0b6', '2fa67bdd-bfc2-465c-9e00-fd1a6a1d7b60', '71d29760-97b0-447c-802d-600bced15cf2', '80f24f8c-1f9c-4382-9d72-749a55b66dd0'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:38:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:43 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:38:43 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:44 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.424s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:44 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:38:44 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Deleted volume successfully. Apr 09 13:38:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-4854ceda-d016-42fe-973e-194ca50edb0b tempest-CinderUnicodeTest-1345968867 None] Lock "cinder-f1fb90a2-5c30-44e8-ab6c-2a9fa2700e5b-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Flow 'volume_create_manager' (2ba23264-df0b-4115-98cd-147c64e388b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443d9afd-9cbb-4523-8f60-f0169d2bfe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443d9afd-9cbb-4523-8f60-f0169d2bfe28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1033503024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed2edc9-8668-4dbc-862d-8dbda98494ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395c3792a5e443038418ab7ca84391dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='8e3090854c5d4a9989ea1fe91aa6138d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670bcb04-69e9-404e-9eab-5f6bd74a978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670bcb04-69e9-404e-9eab-5f6bd74a978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87433251-23f1-48bb-8938-0028cbcd119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87433251-23f1-48bb-8938-0028cbcd119f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed2edc9-8668-4dbc-862d-8dbda98494ae', 'volume_name': 'volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1984326f-9991-4ad7-a37f-a0e6cff1855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1984326f-9991-4ad7-a37f-a0e6cff1855e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8559552a-4e88-408a-9228-f478876ed04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:50 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Volume 9ed2edc9-8668-4dbc-862d-8dbda98494ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae', 'volume_size': 1} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1033503024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed2edc9-8668-4dbc-862d-8dbda98494ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395c3792a5e443038418ab7ca84391dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='8e3090854c5d4a9989ea1fe91aa6138d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Creating volume 9ed2edc9-8668-4dbc-862d-8dbda98494ae {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:50 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:50 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae 1073741824 Apr 09 13:38:50 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Flow 'volume_create_manager' (db615d37-11a0-4a04-ac0f-8b3967561c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc5866b-f90e-41ab-af70-821ac555692e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc5866b-f90e-41ab-af70-821ac555692e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945574889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e04f2a7-f8e1-456a-a7a1-68680f0351be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb04f888041e4ee7b286bab472ad7123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='96e7eb0e8f564f258e782f1bec0bcd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3535428-dd3b-46be-849e-fda2459ef61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3535428-dd3b-46be-849e-fda2459ef61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5eeae4b-c392-4754-9e67-32e7746ed741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5eeae4b-c392-4754-9e67-32e7746ed741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e04f2a7-f8e1-456a-a7a1-68680f0351be', 'volume_name': 'volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb88d51-215a-4079-8344-ba6351c1cc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb88d51-215a-4079-8344-ba6351c1cc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2147c5f-afe5-4f5c-a86a-f89a8ee5b23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:50 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Volume 1e04f2a7-f8e1-456a-a7a1-68680f0351be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be', 'volume_size': 1} Apr 09 13:38:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Flow 'volume_create_manager' (451252d5-dee8-408f-bee4-a5011b05b36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf3407d-7533-4a10-af9f-168e382581ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf3407d-7533-4a10-af9f-168e382581ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1089831782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e4ab37-2562-4139-a5c4-7804e2c4db1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb04f888041e4ee7b286bab472ad7123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='96e7eb0e8f564f258e782f1bec0bcd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7ff091-b08c-4e53-8bf2-62abd535b2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7ff091-b08c-4e53-8bf2-62abd535b2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbed6ba3-cca9-4774-9e1b-a04baf926f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbed6ba3-cca9-4774-9e1b-a04baf926f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09e4ab37-2562-4139-a5c4-7804e2c4db1c', 'volume_name': 'volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7151c491-bbf4-44dd-abec-421864834ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7151c491-bbf4-44dd-abec-421864834ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da750545-72ad-4e76-8fb9-a277b853d389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Volume 09e4ab37-2562-4139-a5c4-7804e2c4db1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c', 'volume_size': 1} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (5adcd748-5a5b-45c3-96d7-169b19bae8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f54a42-7fa0-43d3-a52f-afc35cb002cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f54a42-7fa0-43d3-a52f-afc35cb002cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1471144464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54033d1b-9993-44e1-a983-61647310fb1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab86d79-9f67-4a1d-99ed-7d3dae8ba3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab86d79-9f67-4a1d-99ed-7d3dae8ba3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b010e51c-1bc1-41f7-9adc-a0556cd42457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b010e51c-1bc1-41f7-9adc-a0556cd42457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54033d1b-9993-44e1-a983-61647310fb1b', 'volume_name': 'volume-54033d1b-9993-44e1-a983-61647310fb1b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602a9c89-11a7-4295-8e96-591004a837ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602a9c89-11a7-4295-8e96-591004a837ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74715c0e-01e5-4c9b-a48d-a222d0efbbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume 54033d1b-9993-44e1-a983-61647310fb1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54033d1b-9993-44e1-a983-61647310fb1b', 'volume_size': 1} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Flow 'volume_create_manager' (66776f3d-501d-4d28-981a-b244a0fda7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6b7538-2824-426b-a261-b6c9f11b6e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6b7538-2824-426b-a261-b6c9f11b6e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2054762873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8c50d3-ed58-4c51-9dea-e228f935568f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb04f888041e4ee7b286bab472ad7123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='96e7eb0e8f564f258e782f1bec0bcd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0511fece-b827-4044-84fd-b448161003cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0511fece-b827-4044-84fd-b448161003cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886d18bc-9ac5-49bd-9c9b-17b3fc54a552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886d18bc-9ac5-49bd-9c9b-17b3fc54a552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8c50d3-ed58-4c51-9dea-e228f935568f', 'volume_name': 'volume-4f8c50d3-ed58-4c51-9dea-e228f935568f', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9792ee08-9d97-43af-bb97-1ac619c3f4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9792ee08-9d97-43af-bb97-1ac619c3f4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e06e32-ccb1-422e-9b6f-cb7486038020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Volume 4f8c50d3-ed58-4c51-9dea-e228f935568f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8c50d3-ed58-4c51-9dea-e228f935568f', 'volume_size': 1} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Flow 'volume_create_manager' (30df05d1-e35a-4703-ad83-f096bb33ae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d132f4-87fc-4a96-bf83-d9c7a839f2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d132f4-87fc-4a96-bf83-d9c7a839f2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-769039933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a079ab6-154c-4e96-a7aa-9d45ea5fa65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb04f888041e4ee7b286bab472ad7123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='96e7eb0e8f564f258e782f1bec0bcd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a618708e-2ee3-486a-9642-94bb99d2d82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a618708e-2ee3-486a-9642-94bb99d2d82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e329e7-c1af-452d-9af8-600d5a9e88f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e329e7-c1af-452d-9af8-600d5a9e88f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a079ab6-154c-4e96-a7aa-9d45ea5fa65c', 'volume_name': 'volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297fdb07-4cb9-414c-ae11-9cd487f38307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297fdb07-4cb9-414c-ae11-9cd487f38307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8faf5e-ca9d-4c60-92e3-f0162fc72783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Volume 1a079ab6-154c-4e96-a7aa-9d45ea5fa65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c', 'volume_size': 1} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:51 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae 1073741824" returned: 0 in 0.703s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:51 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae Apr 09 13:38:51 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Flow 'volume_create_manager' (2836a1e3-74b1-4874-8b81-281098ec9f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7176efa0-f64c-46cb-b476-536482dfa46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7176efa0-f64c-46cb-b476-536482dfa46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-336095832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4801a4-8daf-4a9a-a6a5-2813100b83ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb04f888041e4ee7b286bab472ad7123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:52Z,use_quota=True,user_id='96e7eb0e8f564f258e782f1bec0bcd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cdd3fd-1d14-4056-85cf-3923d4d2514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cdd3fd-1d14-4056-85cf-3923d4d2514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223c364f-1b6c-41db-a533-4f6fcd8d2fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223c364f-1b6c-41db-a533-4f6fcd8d2fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4801a4-8daf-4a9a-a6a5-2813100b83ac', 'volume_name': 'volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee808934-9f4e-49e3-b4c1-d2a1b5368238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee808934-9f4e-49e3-b4c1-d2a1b5368238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa57be9-545c-41f3-a9e6-bf8f70e41866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:51 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Volume ab4801a4-8daf-4a9a-a6a5-2813100b83ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac', 'volume_size': 1} Apr 09 13:38:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:52 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae" returned: 0 in 0.454s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.082s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945574889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e04f2a7-f8e1-456a-a7a1-68680f0351be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb04f888041e4ee7b286bab472ad7123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='96e7eb0e8f564f258e782f1bec0bcd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Creating volume 1e04f2a7-f8e1-456a-a7a1-68680f0351be {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:52 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8559552a-4e88-408a-9228-f478876ed04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c2a9d2-1cad-4b63-a426-dca93e280ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:52 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be 1073741824 Apr 09 13:38:52 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:52 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Volume volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae (9ed2edc9-8668-4dbc-862d-8dbda98494ae): created successfully Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c2a9d2-1cad-4b63-a426-dca93e280ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Flow 'volume_create_manager' (2ba23264-df0b-4115-98cd-147c64e388b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:52 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-da7973c7-52de-4a17-b0fc-ceebf92f13c7 tempest-VolumeDependencyTests-1544341491 None] Created volume successfully. Apr 09 13:38:52 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be 1073741824" returned: 0 in 0.506s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:52 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be Apr 09 13:38:52 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:53 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be" returned: 0 in 0.473s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1089831782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09e4ab37-2562-4139-a5c4-7804e2c4db1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb04f888041e4ee7b286bab472ad7123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='96e7eb0e8f564f258e782f1bec0bcd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Creating volume 09e4ab37-2562-4139-a5c4-7804e2c4db1c {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:53 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2147c5f-afe5-4f5c-a86a-f89a8ee5b23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:53 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c 1073741824 Apr 09 13:38:53 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd558dc1-22d2-4821-a981-fe55f151e6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:53 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Volume volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be (1e04f2a7-f8e1-456a-a7a1-68680f0351be): created successfully Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd558dc1-22d2-4821-a981-fe55f151e6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Flow 'volume_create_manager' (db615d37-11a0-4a04-ac0f-8b3967561c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:53 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-77ecc924-89a5-4095-a4ce-89dcc5314974 tempest-CreateVolumesFromImageTest-1974168783 None] Created volume successfully. Apr 09 13:38:53 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c 1073741824" returned: 0 in 0.532s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:53 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:53 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c Apr 09 13:38:53 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:54 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c" returned: 0 in 0.581s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.928s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1471144464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54033d1b-9993-44e1-a983-61647310fb1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Creating volume 54033d1b-9993-44e1-a983-61647310fb1b {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:54 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da750545-72ad-4e76-8fb9-a277b853d389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:54 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b 1073741824 Apr 09 13:38:54 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7404996-5ead-40fa-a3a3-5aa18f08480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:54 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Volume volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c (09e4ab37-2562-4139-a5c4-7804e2c4db1c): created successfully Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7404996-5ead-40fa-a3a3-5aa18f08480f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Flow 'volume_create_manager' (451252d5-dee8-408f-bee4-a5011b05b36f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:54 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-a2a7b33f-ed55-4ee4-9b3c-418383721929 tempest-CreateVolumesFromImageTest-1974168783 None] Created volume successfully. Apr 09 13:38:54 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b 1073741824" returned: 0 in 0.481s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:54 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:54 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b Apr 09 13:38:54 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:55 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b" returned: 0 in 0.499s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.786s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2054762873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8c50d3-ed58-4c51-9dea-e228f935568f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb04f888041e4ee7b286bab472ad7123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='96e7eb0e8f564f258e782f1bec0bcd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Creating volume 4f8c50d3-ed58-4c51-9dea-e228f935568f {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:55 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74715c0e-01e5-4c9b-a48d-a222d0efbbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54033d1b-9993-44e1-a983-61647310fb1b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:55 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f 1073741824 Apr 09 13:38:55 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd93719a-0179-48c3-9911-43f4795f4cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:55 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume volume-54033d1b-9993-44e1-a983-61647310fb1b (54033d1b-9993-44e1-a983-61647310fb1b): created successfully Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd93719a-0179-48c3-9911-43f4795f4cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (5adcd748-5a5b-45c3-96d7-169b19bae8f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:55 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2a50cb1e-ad78-4760-a3b9-f552bbd35a3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created volume successfully. Apr 09 13:38:55 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f 1073741824" returned: 0 in 0.567s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:55 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:55 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f Apr 09 13:38:55 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:56 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f" returned: 0 in 0.452s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.754s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-769039933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a079ab6-154c-4e96-a7aa-9d45ea5fa65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb04f888041e4ee7b286bab472ad7123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:51Z,use_quota=True,user_id='96e7eb0e8f564f258e782f1bec0bcd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Creating volume 1a079ab6-154c-4e96-a7aa-9d45ea5fa65c {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:56 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e06e32-ccb1-422e-9b6f-cb7486038020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8c50d3-ed58-4c51-9dea-e228f935568f', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf891638-b55d-416b-9709-443228a541bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:56 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Volume volume-4f8c50d3-ed58-4c51-9dea-e228f935568f (4f8c50d3-ed58-4c51-9dea-e228f935568f): created successfully Apr 09 13:38:56 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c 1073741824 Apr 09 13:38:56 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf891638-b55d-416b-9709-443228a541bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Flow 'volume_create_manager' (66776f3d-501d-4d28-981a-b244a0fda7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:56 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-8d48f92e-6ad2-4494-9dc1-cbfca8a9a992 tempest-CreateVolumesFromImageTest-1974168783 None] Created volume successfully. Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:56 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c 1073741824" returned: 0 in 0.548s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:56 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:56 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c Apr 09 13:38:56 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:57 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c" returned: 0 in 0.475s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.539s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-336095832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab4801a4-8daf-4a9a-a6a5-2813100b83ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb04f888041e4ee7b286bab472ad7123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:38:52Z,use_quota=True,user_id='96e7eb0e8f564f258e782f1bec0bcd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Creating volume ab4801a4-8daf-4a9a-a6a5-2813100b83ac {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:38:57 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8faf5e-ca9d-4c60-92e3-f0162fc72783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398f00b2-b48e-43f9-8d75-b852e41e2e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:57 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac 1073741824 Apr 09 13:38:57 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:57 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Volume volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c (1a079ab6-154c-4e96-a7aa-9d45ea5fa65c): created successfully Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398f00b2-b48e-43f9-8d75-b852e41e2e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Flow 'volume_create_manager' (30df05d1-e35a-4703-ad83-f096bb33ae90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:57 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d1e90a2f-79c8-4860-8e3a-445f170cefa8 tempest-CreateVolumesFromImageTest-1974168783 None] Created volume successfully. Apr 09 13:38:57 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac 1073741824" returned: 0 in 0.575s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:57 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:58 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac Apr 09 13:38:58 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:58 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac" returned: 0 in 0.497s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:38:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:38:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.451s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:38:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa57be9-545c-41f3-a9e6-bf8f70e41866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd294882-e385-4dba-8c9e-c8034a499e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:38:58 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] Creating offline snapshot 38d034fa-8881-4a9b-93c6-b3734692f145 of volume 9ed2edc9-8668-4dbc-862d-8dbda98494ae {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:38:58 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Volume volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac (ab4801a4-8daf-4a9a-a6a5-2813100b83ac): created successfully Apr 09 13:38:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd294882-e385-4dba-8c9e-c8034a499e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:38:58 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Flow 'volume_create_manager' (2836a1e3-74b1-4874-8b81-281098ec9f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:38:58 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf28f3ce-a383-466d-9021-46ec52122555]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:58 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:58 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-951b6506-d6c2-4bd0-b013-476605573dbc tempest-CreateVolumesFromImageTest-1974168783 None] Created volume successfully. Apr 09 13:38:58 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae Apr 09 13:38:58 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:59 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae" returned: 0 in 0.514s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:59 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 1G Apr 09 13:38:59 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "cinder-ab4801a4-8daf-4a9a-a6a5-2813100b83ac-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-ab4801a4-8daf-4a9a-a6a5-2813100b83ac-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "cinder-quobyte-ab4801a4-8daf-4a9a-a6a5-2813100b83ac" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:38:59 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-quobyte-ab4801a4-8daf-4a9a-a6a5-2813100b83ac" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:38:59 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c25c4d-4ef7-43c6-9beb-8f49f54c458f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:38:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:59 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac Apr 09 13:38:59 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:38:59 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 09 13:38:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 1G" returned: 0 in 0.579s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:38:59 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:38:59 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 Apr 09 13:38:59 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:00 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac" returned: 0 in 0.539s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:00 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac Apr 09 13:39:00 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:00 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145" returned: 0 in 0.520s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:00 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 is being set with open permissions: ugo+rw Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:00 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 Apr 09 13:39:00 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:00 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ab4801a4-8daf-4a9a-a6a5-2813100b83ac" returned: 0 in 0.478s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-quobyte-ab4801a4-8daf-4a9a-a6a5-2813100b83ac" released by "delete_volume" :: held 1.054s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Created reservations ['bca51853-2db0-47b6-9781-8df1454141a1', 'ffba1ae4-43f8-4084-821e-f558cac728f3', '5792a8ce-5082-4970-ad41-18b849633c3b', '06d8797d-e80d-41d9-95c3-79f954d10d63'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:00 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:00 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:00 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145" returned: 0 in 0.503s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:00 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:00 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.info Apr 09 13:39:00 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:01 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.453s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:01 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Deleted volume successfully. Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-3c22055a-ae0c-4709-8e3c-35fee39d5512 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-ab4801a4-8daf-4a9a-a6a5-2813100b83ac-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:01 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.info" returned: 0 in 0.468s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:01 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.info is being set with open permissions: ugo+rw Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:01 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.info Apr 09 13:39:01 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:01 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.info" returned: 0 in 0.465s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.132s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.232s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Creating offline snapshot e30e0904-edc1-4436-a473-61a228d55221 of volume 54033d1b-9993-44e1-a983-61647310fb1b {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "cinder-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae64e11f-c0e4-462b-bcb2-cfa346946883]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:01 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d0db3f34-69f8-4a0b-b1d0-73f0859a271d tempest-VolumeDependencyTests-1544341491 None] Create snapshot completed successfully Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "cinder-quobyte-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-quobyte-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f2e636-bf5d-4da0-af36-4aed7ce28fd3]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:01 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:01 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b Apr 09 13:39:01 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:01 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c Apr 09 13:39:01 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:02 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b" returned: 0 in 0.696s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:02 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c" returned: 0 in 0.637s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:02 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 1G Apr 09 13:39:02 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c Apr 09 13:39:02 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:02 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Flow 'volume_create_manager' (a5c47d5a-1281-49bc-b3b0-aa50ae9e0cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703230f6-13ea-4b8a-94b6-64bf90cbb119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703230f6-13ea-4b8a-94b6-64bf90cbb119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-427867678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3140b77-9f66-4515-833c-b17788689719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395c3792a5e443038418ab7ca84391dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=38d034fa-8881-4a9b-93c6-b3734692f145,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:03Z,use_quota=True,user_id='8e3090854c5d4a9989ea1fe91aa6138d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cedc335-efd2-444f-b215-0d11af533a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cedc335-efd2-444f-b215-0d11af533a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04f0b4a-7696-4697-ab73-de71cb871cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04f0b4a-7696-4697-ab73-de71cb871cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3140b77-9f66-4515-833c-b17788689719', 'volume_name': 'volume-d3140b77-9f66-4515-833c-b17788689719', 'volume_size': 1, 'snapshot_id': '38d034fa-8881-4a9b-93c6-b3734692f145'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027f4d67-0cad-46c0-8f3e-158036cd5d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027f4d67-0cad-46c0-8f3e-158036cd5d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e76e74-4a1c-4ad8-8e72-c29fed0242cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:02 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Volume d3140b77-9f66-4515-833c-b17788689719: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3140b77-9f66-4515-833c-b17788689719', 'volume_size': 1, 'snapshot_id': '38d034fa-8881-4a9b-93c6-b3734692f145'} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:02 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c" returned: 0 in 0.590s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:02 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-quobyte-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c" released by "delete_volume" :: held 1.249s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Created reservations ['49e879b0-78be-4b2a-9c72-97d085fb355c', '9e3da7ee-9cf2-4395-8805-2cffc4bc86a7', 'ae9788f6-4789-4823-8ccc-e9d2f2ca4693', '369715ab-7cfa-4eb9-a1fb-21426f7f30ea'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:03 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:03 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:03 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 1G" returned: 0 in 0.749s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54033d1b-9993-44e1-a983-61647310fb1b -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:03 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54033d1b-9993-44e1-a983-61647310fb1b -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 Apr 09 13:39:03 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:03 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54033d1b-9993-44e1-a983-61647310fb1b -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221" returned: 0 in 0.549s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:03 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 is being set with open permissions: ugo+rw Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:03 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 Apr 09 13:39:03 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:03 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.806s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:03 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Deleted volume successfully. Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "cinder-4f8c50d3-ed58-4c51-9dea-e228f935568f-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-ed87ccca-ed07-4a42-ab89-b3d0196e812f tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-1a079ab6-154c-4e96-a7aa-9d45ea5fa65c-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-4f8c50d3-ed58-4c51-9dea-e228f935568f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "cinder-quobyte-4f8c50d3-ed58-4c51-9dea-e228f935568f" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-quobyte-4f8c50d3-ed58-4c51-9dea-e228f935568f" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a38092-0764-4422-9fa8-c65893e7f832]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:03 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:04 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f Apr 09 13:39:04 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:04 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221" returned: 0 in 0.535s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:04 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.info Apr 09 13:39:04 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:04 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f" returned: 0 in 0.678s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:04 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f Apr 09 13:39:04 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:04 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.info" returned: 0 in 0.637s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:04 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.info is being set with open permissions: ugo+rw Apr 09 13:39:04 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:04 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.info Apr 09 13:39:04 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:05 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f8c50d3-ed58-4c51-9dea-e228f935568f" returned: 0 in 0.520s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-quobyte-4f8c50d3-ed58-4c51-9dea-e228f935568f" released by "delete_volume" :: held 1.222s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Created reservations ['ce37bc7f-0f25-47ee-a433-c9406d09d96f', '0aa2943a-77eb-4a3d-9c08-9f91b9c40fd4', 'df220506-6f1d-4f48-8a8e-810799f36eb9', '764e0e30-8453-4a43-9ed1-2d71052d88b7'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:05 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:05 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Flow 'volume_create_manager' (5d1ab568-9caa-44c1-af8e-4b8a4203a195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417db47c-d2f2-45a3-9bdc-51e0c9b2b023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:05 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.info" returned: 0 in 0.501s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.743s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.546s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-quobyte-38d034fa-8881-4a9b-93c6-b3734692f145-d3140b77-9f66-4515-833c-b17788689719" by "_create_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417db47c-d2f2-45a3-9bdc-51e0c9b2b023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-256303767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cb472f-db84-4f9a-815c-c4b318256973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf13934a62cb4b469bb7335caec7a331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:05Z,use_quota=True,user_id='edd005a0fdfc495a9f75ecefa6a83686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26570e6c-571f-483b-8605-6405f70a1fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26570e6c-571f-483b-8605-6405f70a1fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37aebd20-ebc4-4d47-8c4c-de8a225e54dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37aebd20-ebc4-4d47-8c4c-de8a225e54dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6cb472f-db84-4f9a-815c-c4b318256973', 'volume_name': 'volume-b6cb472f-db84-4f9a-815c-c4b318256973', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880ff916-3b1a-4fc5-994a-cb06d83cc151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880ff916-3b1a-4fc5-994a-cb06d83cc151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c231f73-ae70-4546-8b76-c1903f163808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:05 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Volume b6cb472f-db84-4f9a-815c-c4b318256973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6cb472f-db84-4f9a-815c-c4b318256973', 'volume_size': 1} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:05 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-3e9f3f19-8153-4daf-9d26-5215d6f5849e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Create snapshot completed successfully Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-38d034fa-8881-4a9b-93c6-b3734692f145-d3140b77-9f66-4515-833c-b17788689719" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Creating volume d3140b77-9f66-4515-833c-b17788689719 from snapshot 38d034fa-8881-4a9b-93c6-b3734692f145 {{(pid=82346) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-quobyte-d3140b77-9f66-4515-833c-b17788689719" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-d3140b77-9f66-4515-833c-b17788689719" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] snapshot: 38d034fa-8881-4a9b-93c6-b3734692f145, volume: d3140b77-9f66-4515-833c-b17788689719, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dc5485-b39f-49a2-8cdf-0bec3844e263]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:05 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 Apr 09 13:39:05 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:05 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.455s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:05 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Deleted volume successfully. Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-395e407e-4f00-4a72-9206-308d9aa365fa tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-4f8c50d3-ed58-4c51-9dea-e228f935568f-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:05 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (f1a159e0-20a4-44a0-b8c8-ee3be5934d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e119cb30-c4dc-46c7-a5c8-1a642282d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e119cb30-c4dc-46c7-a5c8-1a642282d814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363215068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847e05c5-a098-4381-983e-8a2700638f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:06Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1edc8b-8f97-4d44-9316-58d027eef119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:05 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d1edc8b-8f97-4d44-9316-58d027eef119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf7cfc3-8b44-4fc8-84e3-4dcb384f92e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf7cfc3-8b44-4fc8-84e3-4dcb384f92e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '847e05c5-a098-4381-983e-8a2700638f85', 'volume_name': 'volume-847e05c5-a098-4381-983e-8a2700638f85', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46e914e-c41a-40c0-9235-8b511a0ab366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46e914e-c41a-40c0-9235-8b511a0ab366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baccc7a8-fd38-4d5e-81ae-fe87c50ab7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume 847e05c5-a098-4381-983e-8a2700638f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-847e05c5-a098-4381-983e-8a2700638f85', 'volume_size': 1} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145" returned: 0 in 0.572s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6a81f4-1d27-4eb6-a1d1-0c35f55e6ce8]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "cinder-09e4ab37-2562-4139-a5c4-7804e2c4db1c-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-09e4ab37-2562-4139-a5c4-7804e2c4db1c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:06 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae Apr 09 13:39:06 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (a6c4a69c-bc26-4157-b228-b7524261b4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d62b89-951c-4ebc-ad12-7a48363c5521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d62b89-951c-4ebc-ad12-7a48363c5521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1297678409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed310aaa-fef0-4770-8d9f-8c96fd994064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:06Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603f2a01-14ab-48b1-b2d0-14588ab55fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603f2a01-14ab-48b1-b2d0-14588ab55fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd5ee50-3b8f-4ac3-902a-5bdfcc2f95bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd5ee50-3b8f-4ac3-902a-5bdfcc2f95bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed310aaa-fef0-4770-8d9f-8c96fd994064', 'volume_name': 'volume-ed310aaa-fef0-4770-8d9f-8c96fd994064', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470bf15d-e017-4ea1-93b6-4a5fbb01fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470bf15d-e017-4ea1-93b6-4a5fbb01fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4dba20-ce5d-405c-8931-48d3f26b2a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume ed310aaa-fef0-4770-8d9f-8c96fd994064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed310aaa-fef0-4770-8d9f-8c96fd994064', 'volume_size': 1} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "cinder-quobyte-09e4ab37-2562-4139-a5c4-7804e2c4db1c" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-quobyte-09e4ab37-2562-4139-a5c4-7804e2c4db1c" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21c7258-2721-4117-ba93-7d35fcf2b371]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:06 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c Apr 09 13:39:06 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (3f7ae7c9-7945-413d-a739-bd79a914ad9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4abc084e-5a23-459a-823d-05e5df61ccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4abc084e-5a23-459a-823d-05e5df61ccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-274164454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc627ed-2f88-42ab-a525-88d1f0c6e531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:06Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef82ecda-d303-40b1-8128-4e923394083e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef82ecda-d303-40b1-8128-4e923394083e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9935aa1a-6822-49f4-a01a-087592b6e51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9935aa1a-6822-49f4-a01a-087592b6e51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc627ed-2f88-42ab-a525-88d1f0c6e531', 'volume_name': 'volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac04ff5-723b-49ae-8aec-c2d2837ba414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac04ff5-723b-49ae-8aec-c2d2837ba414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851f9df0-f398-403a-90e3-3a9b197318f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume 2dc627ed-2f88-42ab-a525-88d1f0c6e531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531', 'volume_size': 1} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:06 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae" returned: 0 in 0.565s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:06 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719 Apr 09 13:39:06 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (31034759-5f31-4d6b-951a-407c67bab60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eed60f9-7437-44a0-a760-e886d1566eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eed60f9-7437-44a0-a760-e886d1566eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1165806236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2055f60-fa44-4528-9d36-b02516a9bcf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:07Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de31151-f774-4f53-a3e2-5daa293822ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de31151-f774-4f53-a3e2-5daa293822ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8438d3c-9111-4d89-a4e2-970cf816f12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8438d3c-9111-4d89-a4e2-970cf816f12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2055f60-fa44-4528-9d36-b02516a9bcf7', 'volume_name': 'volume-f2055f60-fa44-4528-9d36-b02516a9bcf7', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35892f6-b0dc-4ed5-805f-91d319aa38ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35892f6-b0dc-4ed5-805f-91d319aa38ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d74ab7-faf6-4a28-bd36-f3adcb6a5a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume f2055f60-fa44-4528-9d36-b02516a9bcf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2055f60-fa44-4528-9d36-b02516a9bcf7', 'volume_size': 1} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (3d8fbb93-9011-4c5b-8fcb-4e4a0c8e30f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f87135-06f3-418d-9b5b-94887cb53346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f87135-06f3-418d-9b5b-94887cb53346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363089279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e47e24-6405-4fc1-8da6-35141a726d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:07Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2daab8-54f3-41fb-addd-1cd0c886ad30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2daab8-54f3-41fb-addd-1cd0c886ad30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb208dd-b70c-4719-8efd-e7e3de5aaf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb208dd-b70c-4719-8efd-e7e3de5aaf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4e47e24-6405-4fc1-8da6-35141a726d05', 'volume_name': 'volume-d4e47e24-6405-4fc1-8da6-35141a726d05', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3843e09a-4323-4ab5-8882-07f3df4ecfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3843e09a-4323-4ab5-8882-07f3df4ecfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65516887-1c8b-4aea-a280-674012000efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:06 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume d4e47e24-6405-4fc1-8da6-35141a726d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4e47e24-6405-4fc1-8da6-35141a726d05', 'volume_size': 1} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c" returned: 0 in 0.604s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:06 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:06 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c Apr 09 13:39:06 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:07 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-09e4ab37-2562-4139-a5c4-7804e2c4db1c" returned: 0 in 0.652s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:07 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-quobyte-09e4ab37-2562-4139-a5c4-7804e2c4db1c" released by "delete_volume" :: held 1.283s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:07 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Created reservations ['6f5701c1-6244-4ade-af55-88d31b903d52', '46b83055-a7a8-4bfe-acd8-9f7d16350a37', '4be9fa90-4033-465b-9280-dc6bf3f53407', '7b1363af-7fe1-4a1e-94d1-216b7f9351dd'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:07 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:07 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:07 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:07 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "cinder-1e04f2a7-f8e1-456a-a7a1-68680f0351be-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-1e04f2a7-f8e1-456a-a7a1-68680f0351be-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "cinder-quobyte-1e04f2a7-f8e1-456a-a7a1-68680f0351be" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-quobyte-1e04f2a7-f8e1-456a-a7a1-68680f0351be" acquired by "delete_volume" :: waited 0.020s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf79d8d-68d1-4c36-a2fb-43f48718c2cd]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:08 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.853s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:08 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Deleted volume successfully. Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-d760b7c4-01cc-4971-864e-2b91b1ab4368 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-09e4ab37-2562-4139-a5c4-7804e2c4db1c-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:08 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be Apr 09 13:39:08 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:08 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719" returned: 0 in 2.207s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfe1fc0-61d4-4e30-beaf-ef59829dee77]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:08 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:08 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae Apr 09 13:39:08 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:09 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be" returned: 0 in 0.572s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:09 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be Apr 09 13:39:09 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:09 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae" returned: 0 in 0.572s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:39:09 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Converted 1024.00 MB image at 463.85 MB/s Apr 09 13:39:09 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719 is being set with open permissions: ugo+rw Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:09 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719 Apr 09 13:39:09 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:09 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-1e04f2a7-f8e1-456a-a7a1-68680f0351be" returned: 0 in 0.417s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-quobyte-1e04f2a7-f8e1-456a-a7a1-68680f0351be" released by "delete_volume" :: held 1.036s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Created reservations ['838ed0fe-8b94-49d7-8f74-bb4462015f22', '90274589-a78b-4820-9ece-2aa4a05c49ae', 'fb86e9dc-81bd-43a1-986a-8dc4044da196', '46bf99e9-ae29-4ee5-bcc0-9124fc960933'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:09 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:09 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:09 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719" returned: 0 in 0.442s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-d3140b77-9f66-4515-833c-b17788689719" released by "_copy_volume_from_snapshot" :: held 4.421s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-38d034fa-8881-4a9b-93c6-b3734692f145-d3140b77-9f66-4515-833c-b17788689719" released by "_create_volume_from_snapshot" :: held 4.437s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.482s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.462s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-256303767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cb472f-db84-4f9a-815c-c4b318256973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf13934a62cb4b469bb7335caec7a331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:05Z,use_quota=True,user_id='edd005a0fdfc495a9f75ecefa6a83686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Creating volume b6cb472f-db84-4f9a-815c-c4b318256973 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:09 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:09 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 1073741824 Apr 09 13:39:09 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e76e74-4a1c-4ad8-8e72-c29fed0242cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3140b77-9f66-4515-833c-b17788689719', 'volume_size': 1, 'snapshot_id': '38d034fa-8881-4a9b-93c6-b3734692f145'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f309ac32-1121-4cfe-befd-0efcba6d8c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:09 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Volume volume-d3140b77-9f66-4515-833c-b17788689719 (d3140b77-9f66-4515-833c-b17788689719): created successfully Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f309ac32-1121-4cfe-befd-0efcba6d8c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:09 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Flow 'volume_create_manager' (a5c47d5a-1281-49bc-b3b0-aa50ae9e0cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:09 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-f3b15afe-1d09-49c7-b8a6-89ccc57c099c tempest-VolumeDependencyTests-1544341491 None] Created volume successfully. Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-38d034fa-8881-4a9b-93c6-b3734692f145-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-38d034fa-8881-4a9b-93c6-b3734692f145-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-quobyte-9ed2edc9-8668-4dbc-862d-8dbda98494ae" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-9ed2edc9-8668-4dbc-862d-8dbda98494ae" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-quobyte-38d034fa-8881-4a9b-93c6-b3734692f145" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-38d034fa-8881-4a9b-93c6-b3734692f145" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Deleting offline snapshot 38d034fa-8881-4a9b-93c6-b3734692f145 of volume 9ed2edc9-8668-4dbc-862d-8dbda98494ae {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] snapshot_file for this snap is: volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f761f-5a16-4150-9a61-59ab1b7ec97f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:10 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.473s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:10 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Deleted volume successfully. Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e837a180-54a6-4a81-b2a0-4ceb18e832d0 tempest-CreateVolumesFromImageTest-1974168783 None] Lock "cinder-1e04f2a7-f8e1-456a-a7a1-68680f0351be-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:10 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 Apr 09 13:39:10 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:10 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 1073741824" returned: 0 in 0.546s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:10 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 Apr 09 13:39:10 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:10 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145" returned: 0 in 0.520s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[8229732b-ea0e-4edb-841a-5831f4839e83]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:10 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae Apr 09 13:39:10 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:10 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973" returned: 0 in 0.430s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.853s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363215068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847e05c5-a098-4381-983e-8a2700638f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:06Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Creating volume 847e05c5-a098-4381-983e-8a2700638f85 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:10 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c231f73-ae70-4546-8b76-c1903f163808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6cb472f-db84-4f9a-815c-c4b318256973', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4d99e8-e22a-4b95-bf03-663b662ab5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:10 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85 1073741824 Apr 09 13:39:10 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:10 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Volume volume-b6cb472f-db84-4f9a-815c-c4b318256973 (b6cb472f-db84-4f9a-815c-c4b318256973): created successfully Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4d99e8-e22a-4b95-bf03-663b662ab5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:10 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Flow 'volume_create_manager' (5d1ab568-9caa-44c1-af8e-4b8a4203a195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:10 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-50bd35a4-13cb-41ea-9d4a-1ab6eb5acc5e tempest-SnapshotDependencyTests-792036205 None] Created volume successfully. Apr 09 13:39:11 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae" returned: 0 in 0.555s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:11 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 Apr 09 13:39:11 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:11 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85 1073741824" returned: 0 in 0.587s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:11 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85 Apr 09 13:39:11 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:11 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145" returned: 0 in 0.554s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:11 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:11 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145 Apr 09 13:39:11 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:12 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85" returned: 0 in 0.602s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.855s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1297678409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed310aaa-fef0-4770-8d9f-8c96fd994064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:06Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Creating volume ed310aaa-fef0-4770-8d9f-8c96fd994064 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:12 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baccc7a8-fd38-4d5e-81ae-fe87c50ab7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-847e05c5-a098-4381-983e-8a2700638f85', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8ad883-1fc3-45c0-a4d2-b45074ab9467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:12 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume volume-847e05c5-a098-4381-983e-8a2700638f85 (847e05c5-a098-4381-983e-8a2700638f85): created successfully Apr 09 13:39:12 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064 1073741824 Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8ad883-1fc3-45c0-a4d2-b45074ab9467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:12 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (f1a159e0-20a4-44a0-b8c8-ee3be5934d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:12 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-cded23a7-f429-4581-b70b-b4ea47312c24 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created volume successfully. Apr 09 13:39:12 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae.38d034fa-8881-4a9b-93c6-b3734692f145" returned: 0 in 0.577s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-38d034fa-8881-4a9b-93c6-b3734692f145" released by "_delete_snapshot" :: held 2.271s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-9ed2edc9-8668-4dbc-862d-8dbda98494ae" released by "delete_snapshot" :: held 2.283s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Created reservations ['c9beef19-1477-490c-8a06-2a4f16e44191', '176023dc-0e71-4fd0-98e2-7f3320edd2eb', 'ac61cd63-aec4-41d9-92d5-f3ace9cef3f3', '21da9f2b-4d74-4be7-b27a-f3db8a302e2e'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:12 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Delete snapshot completed successfully. Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-27e93f39-c03f-4562-95f0-b7de9f381d74 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-38d034fa-8881-4a9b-93c6-b3734692f145-delete_snapshot" released by "delete_snapshot" :: held 2.379s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (c6981690-edc9-4fcf-9bff-3e6bab665311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68ca699-2ec7-41be-a109-9695bab775f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68ca699-2ec7-41be-a109-9695bab775f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-46770518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16c23e5-ee52-45a5-9616-6c8150ef509a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:13Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d323d83-87a8-45a1-a1a0-92e472094904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d323d83-87a8-45a1-a1a0-92e472094904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8caf04-0e39-4379-ac81-d72635423540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8caf04-0e39-4379-ac81-d72635423540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16c23e5-ee52-45a5-9616-6c8150ef509a', 'volume_name': 'volume-b16c23e5-ee52-45a5-9616-6c8150ef509a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e50aa1-903d-4705-8c23-0628402a0634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e50aa1-903d-4705-8c23-0628402a0634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961aba0d-badc-4d9e-b06c-c60fa248b4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:12 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume b16c23e5-ee52-45a5-9616-6c8150ef509a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16c23e5-ee52-45a5-9616-6c8150ef509a', 'volume_size': 1} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:12 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064 1073741824" returned: 0 in 0.588s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:12 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:12 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064 Apr 09 13:39:12 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:13 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064" returned: 0 in 0.421s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.706s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-274164454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc627ed-2f88-42ab-a525-88d1f0c6e531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:06Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Creating volume 2dc627ed-2f88-42ab-a525-88d1f0c6e531 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:13 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4dba20-ce5d-405c-8931-48d3f26b2a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed310aaa-fef0-4770-8d9f-8c96fd994064', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:13 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531 1073741824 Apr 09 13:39:13 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8d841e-dbd5-4343-ae56-29cdff79e4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:13 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume volume-ed310aaa-fef0-4770-8d9f-8c96fd994064 (ed310aaa-fef0-4770-8d9f-8c96fd994064): created successfully Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8d841e-dbd5-4343-ae56-29cdff79e4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (a6c4a69c-bc26-4157-b228-b7524261b4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:13 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-57708f70-d8f1-48b3-8f40-91906f039bd3 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created volume successfully. Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-9ed2edc9-8668-4dbc-862d-8dbda98494ae-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-9ed2edc9-8668-4dbc-862d-8dbda98494ae-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-quobyte-9ed2edc9-8668-4dbc-862d-8dbda98494ae" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-9ed2edc9-8668-4dbc-862d-8dbda98494ae" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d33bfae-3790-4039-8173-6eb4fcbe350d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:13 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae Apr 09 13:39:13 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:13 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531 1073741824" returned: 0 in 0.491s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:13 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531 Apr 09 13:39:13 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:13 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae" returned: 0 in 0.486s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:13 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:13 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae Apr 09 13:39:13 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:14 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531" returned: 0 in 0.394s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.397s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1165806236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2055f60-fa44-4528-9d36-b02516a9bcf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:07Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Creating volume f2055f60-fa44-4528-9d36-b02516a9bcf7 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:14 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851f9df0-f398-403a-90e3-3a9b197318f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d29ca0-a3f6-4333-95e6-28991a0d5352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:14 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7 1073741824 Apr 09 13:39:14 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:14 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531 (2dc627ed-2f88-42ab-a525-88d1f0c6e531): created successfully Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d29ca0-a3f6-4333-95e6-28991a0d5352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (3f7ae7c9-7945-413d-a739-bd79a914ad9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:14 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-df77aae7-4acb-4a08-a8af-4d34700faee9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created volume successfully. Apr 09 13:39:14 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-9ed2edc9-8668-4dbc-862d-8dbda98494ae" returned: 0 in 0.461s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-9ed2edc9-8668-4dbc-862d-8dbda98494ae" released by "delete_volume" :: held 0.974s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Created reservations ['12f797fc-972f-48b2-b7d1-bd8e4c672f22', '499499d2-1646-4fcb-8453-1a4df7baedbd', 'e351d915-8834-449a-9bee-dcad0127cbe2', 'b117bc2f-1947-44c8-aef0-3a1f235a24e7'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:14 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:14 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:14 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7 1073741824" returned: 0 in 0.471s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:14 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7 Apr 09 13:39:14 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:14 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.425s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:14 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Deleted volume successfully. Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b18fe1d9-3d7a-4182-8707-4db7215f7832 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-9ed2edc9-8668-4dbc-862d-8dbda98494ae-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:14 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7" returned: 0 in 0.393s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.093s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363089279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e47e24-6405-4fc1-8da6-35141a726d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279c4c66baf547428bdf63ebe6eb2214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:07Z,use_quota=True,user_id='42d06b6842264cfd802cb23d91e56943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Creating volume d4e47e24-6405-4fc1-8da6-35141a726d05 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:14 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:14 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d74ab7-faf6-4a28-bd36-f3adcb6a5a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2055f60-fa44-4528-9d36-b02516a9bcf7', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:15 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05 1073741824 Apr 09 13:39:15 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2143fc49-4ceb-4a10-bf07-d8f654394b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:15 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume volume-f2055f60-fa44-4528-9d36-b02516a9bcf7 (f2055f60-fa44-4528-9d36-b02516a9bcf7): created successfully Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2143fc49-4ceb-4a10-bf07-d8f654394b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (31034759-5f31-4d6b-951a-407c67bab60d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:15 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-68f1ac54-a5c0-4881-9a29-83e4d3d56e51 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created volume successfully. Apr 09 13:39:15 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05 1073741824" returned: 0 in 0.518s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:15 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05 Apr 09 13:39:15 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Flow 'volume_create_manager' (b960d391-6440-4e50-bcbd-ceca39dc31e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02284fa-84df-462e-a1e1-809492824510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02284fa-84df-462e-a1e1-809492824510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-106220173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a007dd2d-10de-4343-b3a3-50d12b20ce4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395c3792a5e443038418ab7ca84391dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:16Z,use_quota=True,user_id='8e3090854c5d4a9989ea1fe91aa6138d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e621ecd7-0877-4ce7-8671-dcc06032835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e621ecd7-0877-4ce7-8671-dcc06032835a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f71e46e-3ab6-4acf-af0f-91381fa572f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f71e46e-3ab6-4acf-af0f-91381fa572f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a007dd2d-10de-4343-b3a3-50d12b20ce4b', 'volume_name': 'volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8793b4f7-4874-4f36-b920-3ee9a2f5ccab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8793b4f7-4874-4f36-b920-3ee9a2f5ccab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fdce32-d11d-4c1f-a970-8d96128fdd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:15 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Volume a007dd2d-10de-4343-b3a3-50d12b20ce4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b', 'volume_size': 1} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:15 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05" returned: 0 in 0.397s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.859s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65516887-1c8b-4aea-a280-674012000efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e47e24-6405-4fc1-8da6-35141a726d05', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effac84d-118e-404c-9a1a-89c17ffd6ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] Creating offline snapshot 58d6a696-b818-49f9-ba6d-dab3c2f8493e of volume b6cb472f-db84-4f9a-815c-c4b318256973 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:39:15 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Volume volume-d4e47e24-6405-4fc1-8da6-35141a726d05 (d4e47e24-6405-4fc1-8da6-35141a726d05): created successfully Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effac84d-118e-404c-9a1a-89c17ffd6ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Flow 'volume_create_manager' (3d8fbb93-9011-4c5b-8fcb-4e4a0c8e30f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01d6be1-170a-4aac-8c1d-3860741b1be9]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:15 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:15 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-36e54ab6-afa1-4fcc-b7bb-ac1f35f65237 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created volume successfully. Apr 09 13:39:16 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 Apr 09 13:39:16 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:16 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973" returned: 0 in 0.452s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:16 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e 1G Apr 09 13:39:16 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:16 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-d4e47e24-6405-4fc1-8da6-35141a726d05-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:16 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-d4e47e24-6405-4fc1-8da6-35141a726d05-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:16 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-quobyte-d4e47e24-6405-4fc1-8da6-35141a726d05" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:16 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-d4e47e24-6405-4fc1-8da6-35141a726d05" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:16 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[4382b540-dd91-4a88-aaf8-a912039c8894]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:16 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05 Apr 09 13:39:16 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:16 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e 1G" returned: 0 in 0.510s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:16 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cb472f-db84-4f9a-815c-c4b318256973 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:16 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cb472f-db84-4f9a-815c-c4b318256973 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e Apr 09 13:39:16 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:17 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05" returned: 0 in 0.470s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:17 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05 Apr 09 13:39:17 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:17 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cb472f-db84-4f9a-815c-c4b318256973 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e" returned: 0 in 0.439s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:17 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e is being set with open permissions: ugo+rw Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:17 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e Apr 09 13:39:17 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:17 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d4e47e24-6405-4fc1-8da6-35141a726d05" returned: 0 in 0.424s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-d4e47e24-6405-4fc1-8da6-35141a726d05" released by "delete_volume" :: held 0.924s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created reservations ['8180198f-fe49-4d7a-9aea-5599aeb0bb81', '47d039d5-6ea3-46f2-a2c1-a04327fb747c', 'b7b8d490-c2fd-4c96-bb0e-6a5bcbda4671', 'bbf106a6-07e4-4325-a918-cd74a6395ee2'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:17 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:17 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-f2055f60-fa44-4528-9d36-b02516a9bcf7-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-f2055f60-fa44-4528-9d36-b02516a9bcf7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-quobyte-f2055f60-fa44-4528-9d36-b02516a9bcf7" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-f2055f60-fa44-4528-9d36-b02516a9bcf7" acquired by "delete_volume" :: waited 0.006s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8390418-b5eb-43ed-a909-8678f102da4e]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:17 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7 Apr 09 13:39:17 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:17 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e" returned: 0 in 0.465s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:17 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:17 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.info Apr 09 13:39:17 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:18 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.473s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:18 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Deleted volume successfully. Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-0ade8fdb-3f41-4600-ad68-07f249fdf369 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-d4e47e24-6405-4fc1-8da6-35141a726d05-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:18 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7" returned: 0 in 0.491s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:18 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7 Apr 09 13:39:18 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:18 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.info" returned: 0 in 0.444s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:18 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.info is being set with open permissions: ugo+rw Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:18 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.info Apr 09 13:39:18 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:18 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-f2055f60-fa44-4528-9d36-b02516a9bcf7" returned: 0 in 0.395s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-f2055f60-fa44-4528-9d36-b02516a9bcf7" released by "delete_volume" :: held 0.921s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created reservations ['fae4ac5d-a34c-4eb4-8c70-525a990da1cf', 'bd3cc52e-a969-46f6-abef-74b2463c59cb', 'e8dc8d2a-f489-4c01-a75f-ea70a62f4419', 'e59d6d0e-2777-4ac8-a743-df497af0e433'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:18 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:18 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:18 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.info" returned: 0 in 0.393s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.778s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.038s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-46770518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16c23e5-ee52-45a5-9616-6c8150ef509a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:13Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Creating volume b16c23e5-ee52-45a5-9616-6c8150ef509a {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:18 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:18 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-cf245f84-8112-40f4-ad6d-1cd393449223 tempest-SnapshotDependencyTests-792036205 None] Create snapshot completed successfully Apr 09 13:39:18 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a 1073741824 Apr 09 13:39:18 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-2dc627ed-2f88-42ab-a525-88d1f0c6e531-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-2dc627ed-2f88-42ab-a525-88d1f0c6e531-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-quobyte-2dc627ed-2f88-42ab-a525-88d1f0c6e531" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-2dc627ed-2f88-42ab-a525-88d1f0c6e531" acquired by "delete_volume" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[97975921-d475-4228-8f22-3bf7452677f4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:18 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:18 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531 Apr 09 13:39:18 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:19 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.451s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:19 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Deleted volume successfully. Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e157bdbe-3fac-44e4-bd94-17281806694e tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-f2055f60-fa44-4528-9d36-b02516a9bcf7-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:19 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a 1073741824" returned: 0 in 0.540s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:19 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a Apr 09 13:39:19 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:19 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531" returned: 0 in 0.511s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:19 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531 Apr 09 13:39:19 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Flow 'volume_create_manager' (70f0d985-5391-4305-adc4-9e945c767c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80d7826-87bc-407e-a7f4-3254c242adb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80d7826-87bc-407e-a7f4-3254c242adb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf13934a62cb4b469bb7335caec7a331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=58d6a696-b818-49f9-ba6d-dab3c2f8493e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:20Z,use_quota=True,user_id='edd005a0fdfc495a9f75ecefa6a83686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72de4166-d931-4ee8-b94f-b86166362900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72de4166-d931-4ee8-b94f-b86166362900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232d9b44-7522-4d99-b8c6-c9495019a92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232d9b44-7522-4d99-b8c6-c9495019a92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509', 'volume_name': 'volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509', 'volume_size': 1, 'snapshot_id': '58d6a696-b818-49f9-ba6d-dab3c2f8493e'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1a85b8-243f-4e25-a4a8-f25b994ceb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1a85b8-243f-4e25-a4a8-f25b994ceb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7078a02e-1e92-47d2-a5ac-615af7ddda70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:19 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Volume 4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509', 'volume_size': 1, 'snapshot_id': '58d6a696-b818-49f9-ba6d-dab3c2f8493e'} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:19 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-2dc627ed-2f88-42ab-a525-88d1f0c6e531" returned: 0 in 0.392s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:19 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-2dc627ed-2f88-42ab-a525-88d1f0c6e531" released by "delete_volume" :: held 0.925s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a" returned: 0 in 0.505s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.052s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-106220173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a007dd2d-10de-4343-b3a3-50d12b20ce4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395c3792a5e443038418ab7ca84391dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:16Z,use_quota=True,user_id='8e3090854c5d4a9989ea1fe91aa6138d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Creating volume a007dd2d-10de-4343-b3a3-50d12b20ce4b {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:19 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:19 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b 1073741824 Apr 09 13:39:19 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961aba0d-badc-4d9e-b06c-c60fa248b4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16c23e5-ee52-45a5-9616-6c8150ef509a', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9762b5f-fa8b-49c7-9837-eece58aa8ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:19 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume volume-b16c23e5-ee52-45a5-9616-6c8150ef509a (b16c23e5-ee52-45a5-9616-6c8150ef509a): created successfully Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9762b5f-fa8b-49c7-9837-eece58aa8ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (c6981690-edc9-4fcf-9bff-3e6bab665311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:19 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-60341e8c-86d0-409c-871e-4233d42c7904 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created volume successfully. Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created reservations ['5f6f6998-a2d0-4915-a465-94349e844a3c', '9dfb88e3-704a-42c2-8ef0-fcdf5f126206', 'ade095d3-1f6b-415c-81ec-d30a05f195c4', '6b6b9d06-c461-48b8-ab1e-3a0bf837ace6'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:19 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:19 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:19 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (110e54c3-3150-4b08-b0eb-4759d69d10f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007ff924-3394-4708-912d-2b747f5485be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007ff924-3394-4708-912d-2b747f5485be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1772462626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130dc43b-8877-4a9d-adfe-ffad3d9bb333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:20Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa70110-f669-4da5-bb27-e883c0ef6c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa70110-f669-4da5-bb27-e883c0ef6c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3390e2-53e4-4bf5-b364-8985f61e1eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3390e2-53e4-4bf5-b364-8985f61e1eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130dc43b-8877-4a9d-adfe-ffad3d9bb333', 'volume_name': 'volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7403c04b-4d83-40fe-8d71-9ef4bc11a68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7403c04b-4d83-40fe-8d71-9ef4bc11a68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e05640d-5cbf-4f1e-8840-f8dde76f989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume 130dc43b-8877-4a9d-adfe-ffad3d9bb333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333', 'volume_size': 1} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:20 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:20 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b 1073741824" returned: 0 in 0.603s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.476s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:20 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Deleted volume successfully. Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (742fe8cf-f72b-4e2a-9ee1-2d068d6b281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba35c76-13e8-4fef-8656-a2fe9bd1f3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e28b2304-eb51-447f-8a0f-7243325fae9d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-2dc627ed-2f88-42ab-a525-88d1f0c6e531-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba35c76-13e8-4fef-8656-a2fe9bd1f3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-18030184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970475d7-48b0-4ff2-949b-4c4118c8c49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:20Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d58db7-2a03-45a4-af85-8b5772406dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d58db7-2a03-45a4-af85-8b5772406dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9996f74c-5d62-468a-86b3-0eb325aef863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9996f74c-5d62-468a-86b3-0eb325aef863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970475d7-48b0-4ff2-949b-4c4118c8c49c', 'volume_name': 'volume-970475d7-48b0-4ff2-949b-4c4118c8c49c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee52992-f0e6-47a0-adb2-b3e3f941c3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ee52992-f0e6-47a0-adb2-b3e3f941c3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d01110-2623-4148-bffa-652992f11500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume 970475d7-48b0-4ff2-949b-4c4118c8c49c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970475d7-48b0-4ff2-949b-4c4118c8c49c', 'volume_size': 1} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:20 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b Apr 09 13:39:20 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (f1ff277a-1b0f-4114-aa40-f51087e9fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee20c54c-e99d-424b-b02c-712dd6037312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee20c54c-e99d-424b-b02c-712dd6037312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164611197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbdde2df-e5b2-4baf-a128-ab763fb9ed1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:21Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0c23d0-a752-4f0c-91c2-bbfd0ebfec21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0c23d0-a752-4f0c-91c2-bbfd0ebfec21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b771317-749b-41ca-9c0b-d01442a05ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b771317-749b-41ca-9c0b-d01442a05ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbdde2df-e5b2-4baf-a128-ab763fb9ed1d', 'volume_name': 'volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ffcd56-0fbc-4c3b-b093-bbc2b128f147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ffcd56-0fbc-4c3b-b093-bbc2b128f147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d1ac8f-fd2c-4a27-b482-20f5ce28d2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume fbdde2df-e5b2-4baf-a128-ab763fb9ed1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d', 'volume_size': 1} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (bbcc1fc5-ac42-410a-b915-98daa72f046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8026506a-ff30-4a94-bebc-133e84c907f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8026506a-ff30-4a94-bebc-133e84c907f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2012559846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c27630-eed5-488b-83c4-149b6fd0961c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:21Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0410bfa2-7bdf-40bb-9b1c-0eb306af3448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0410bfa2-7bdf-40bb-9b1c-0eb306af3448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36740576-5c2b-44a4-8168-12d75fe94a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36740576-5c2b-44a4-8168-12d75fe94a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c27630-eed5-488b-83c4-149b6fd0961c', 'volume_name': 'volume-07c27630-eed5-488b-83c4-149b6fd0961c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357b5250-c21d-416d-857e-1bb9b2858d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357b5250-c21d-416d-857e-1bb9b2858d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea1e8d3-a75b-4279-9680-3940f6b3b213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:20 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume 07c27630-eed5-488b-83c4-149b6fd0961c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c27630-eed5-488b-83c4-149b6fd0961c', 'volume_size': 1} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-ed310aaa-fef0-4770-8d9f-8c96fd994064-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:20 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-ed310aaa-fef0-4770-8d9f-8c96fd994064-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:21 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-quobyte-ed310aaa-fef0-4770-8d9f-8c96fd994064" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b" returned: 0 in 0.513s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.324s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "cinder-quobyte-58d6a696-b818-49f9-ba6d-dab3c2f8493e-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" by "_create_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fdce32-d11d-4c1f-a970-8d96128fdd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d654ba-aa93-432d-83b2-d9777acc9afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-ed310aaa-fef0-4770-8d9f-8c96fd994064" acquired by "delete_volume" :: waited 0.023s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[567f4169-4bfd-4d32-9480-cc2ed23e8648]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-58d6a696-b818-49f9-ba6d-dab3c2f8493e-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Creating volume 4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 from snapshot 58d6a696-b818-49f9-ba6d-dab3c2f8493e {{(pid=82346) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "cinder-quobyte-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:21 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Volume volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b (a007dd2d-10de-4343-b3a3-50d12b20ce4b): created successfully Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d654ba-aa93-432d-83b2-d9777acc9afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Flow 'volume_create_manager' (b960d391-6440-4e50-bcbd-ceca39dc31e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:21 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-44a8bd6b-8efc-406c-b118-1cda178686a9 tempest-VolumeDependencyTests-1544341491 None] Created volume successfully. Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] snapshot: 58d6a696-b818-49f9-ba6d-dab3c2f8493e, volume: 4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (06043cdd-60bc-41a2-bf8b-5255cbd66ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e89330-2f00-4750-a7b5-bdb713840965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:21 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064 Apr 09 13:39:21 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b020f7e3-1373-4625-a738-684db6237a71]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e89330-2f00-4750-a7b5-bdb713840965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794327827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5cb77b-3ea2-42dd-8284-9bfed74e8d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:21Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20411db-2edf-4c0d-b7fa-f73430834ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20411db-2edf-4c0d-b7fa-f73430834ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d92251-f60f-4dbe-89c6-aaf64062689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d92251-f60f-4dbe-89c6-aaf64062689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5cb77b-3ea2-42dd-8284-9bfed74e8d71', 'volume_name': 'volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cf2a16-59f4-431d-be1a-cef0373ccd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cf2a16-59f4-431d-be1a-cef0373ccd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7792d42-774d-4969-9ed8-850b4b55248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:21 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume aa5cb77b-3ea2-42dd-8284-9bfed74e8d71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71', 'volume_size': 1} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:21 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e Apr 09 13:39:21 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:21 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064" returned: 0 in 0.497s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:21 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064 Apr 09 13:39:21 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:21 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e" returned: 0 in 0.472s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6cb472f-db84-4f9a-815c-c4b318256973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cfef11-2ea2-417e-a094-82d8b30f81a3]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:21 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 Apr 09 13:39:21 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:21 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:21 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-ed310aaa-fef0-4770-8d9f-8c96fd994064" returned: 0 in 0.418s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-ed310aaa-fef0-4770-8d9f-8c96fd994064" released by "delete_volume" :: held 0.938s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created reservations ['aff7fad9-8c89-4e0b-b3da-afd007a6f9b7', 'c23f6080-b7a1-4a27-ab81-c0a43b54a240', '6b685c59-4c4e-40a4-90f9-11719a88dcea', '542b8158-e833-414a-bdd5-93f840c2be06'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:22 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:22 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-847e05c5-a098-4381-983e-8a2700638f85-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:22 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973" returned: 0 in 0.518s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-847e05c5-a098-4381-983e-8a2700638f85-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:22 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 Apr 09 13:39:22 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-quobyte-847e05c5-a098-4381-983e-8a2700638f85" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-847e05c5-a098-4381-983e-8a2700638f85" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7a1e05-a4b2-497c-afbf-7a430f09398e]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Flow 'volume_create_manager' (858c42d4-c2d5-46e5-bad2-0cda5d40acfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f201477b-2187-4da7-9072-4ded41a874f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:22 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85 Apr 09 13:39:22 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f201477b-2187-4da7-9072-4ded41a874f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-138585571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ee7376-ab3c-490d-abfe-3b1983a3de44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395c3792a5e443038418ab7ca84391dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a007dd2d-10de-4343-b3a3-50d12b20ce4b,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:22Z,use_quota=True,user_id='8e3090854c5d4a9989ea1fe91aa6138d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e0952f-b9cc-405b-af0f-2da5fef6b91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e0952f-b9cc-405b-af0f-2da5fef6b91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11f287d-8215-49c0-bf45-97312e7c39e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11f287d-8215-49c0-bf45-97312e7c39e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '19ee7376-ab3c-490d-abfe-3b1983a3de44', 'volume_name': 'volume-19ee7376-ab3c-490d-abfe-3b1983a3de44', 'volume_size': 1, 'source_volid': 'a007dd2d-10de-4343-b3a3-50d12b20ce4b', 'source_volstatus': 'available'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c25e5c-3a08-498e-a293-50d646b7acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c25e5c-3a08-498e-a293-50d646b7acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9af25a9-59ae-44fb-94e9-b4c9a0a63c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:22 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Volume 19ee7376-ab3c-490d-abfe-3b1983a3de44: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-19ee7376-ab3c-490d-abfe-3b1983a3de44', 'volume_size': 1, 'source_volid': 'a007dd2d-10de-4343-b3a3-50d12b20ce4b', 'source_volstatus': 'available'} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:22 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.468s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:22 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Deleted volume successfully. Apr 09 13:39:22 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-e80d856b-2e1a-4796-9639-893060035e3a tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-ed310aaa-fef0-4770-8d9f-8c96fd994064-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:23 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85" returned: 0 in 0.784s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:23 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85 Apr 09 13:39:23 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:23 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-847e05c5-a098-4381-983e-8a2700638f85" returned: 0 in 0.700s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:23 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-847e05c5-a098-4381-983e-8a2700638f85" released by "delete_volume" :: held 1.528s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:23 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created reservations ['3094f6d5-36e0-47de-9296-58ef9aa1dfb4', '119fb5fc-062e-4def-af68-082791668c03', 'e0fd80f0-36fd-491c-a350-a2fa5d49b06b', 'b6abb5e8-5a33-4af5-b90a-a8f822f4773b'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:23 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:23 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:24 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:24 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:24 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" returned: 0 in 2.112s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd216516-12d7-4cdc-a31e-299e862bbc47]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:24 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 Apr 09 13:39:24 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-e30e0904-edc1-4436-a473-61a228d55221-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-e30e0904-edc1-4436-a473-61a228d55221-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-quobyte-54033d1b-9993-44e1-a983-61647310fb1b" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-54033d1b-9993-44e1-a983-61647310fb1b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-quobyte-e30e0904-edc1-4436-a473-61a228d55221" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-e30e0904-edc1-4436-a473-61a228d55221" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Deleting offline snapshot e30e0904-edc1-4436-a473-61a228d55221 of volume 54033d1b-9993-44e1-a983-61647310fb1b {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] snapshot_file for this snap is: volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fab4673-c904-4044-a267-4a72cb41b674]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:24 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 Apr 09 13:39:24 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:24 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.587s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:24 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Deleted volume successfully. Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-fd7a95d0-1c32-4411-b193-668f5080804d tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-847e05c5-a098-4381-983e-8a2700638f85-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:24 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973" returned: 0 in 0.615s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:39:24 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Converted 1024.00 MB image at 484.57 MB/s Apr 09 13:39:24 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 is being set with open permissions: ugo+rw Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:24 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 Apr 09 13:39:24 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:24 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221" returned: 0 in 0.479s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54033d1b-9993-44e1-a983-61647310fb1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[df67948b-d2fd-4ac9-9791-e7a86a665181]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:24 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:25 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b Apr 09 13:39:25 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:25 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" returned: 0 in 0.403s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" released by "_copy_volume_from_snapshot" :: held 4.202s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-58d6a696-b818-49f9-ba6d-dab3c2f8493e-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" released by "_create_volume_from_snapshot" :: held 4.244s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.284s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.051s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1772462626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130dc43b-8877-4a9d-adfe-ffad3d9bb333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:20Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Creating volume 130dc43b-8877-4a9d-adfe-ffad3d9bb333 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:25 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:25 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333 1073741824 Apr 09 13:39:25 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7078a02e-1e92-47d2-a5ac-615af7ddda70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509', 'volume_size': 1, 'snapshot_id': '58d6a696-b818-49f9-ba6d-dab3c2f8493e'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e921deaa-c113-4a59-8063-ce56c84cffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:25 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Volume volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 (4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509): created successfully Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e921deaa-c113-4a59-8063-ce56c84cffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Flow 'volume_create_manager' (70f0d985-5391-4305-adc4-9e945c767c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:25 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-440c31eb-eca6-4103-878f-4c311ddfed7a tempest-SnapshotDependencyTests-792036205 None] Created volume successfully. Apr 09 13:39:25 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b" returned: 0 in 0.479s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:25 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 Apr 09 13:39:25 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:25 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333 1073741824" returned: 0 in 0.486s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:25 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333 Apr 09 13:39:25 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:25 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221" returned: 0 in 0.460s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:25 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:25 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221 Apr 09 13:39:25 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "cinder-58d6a696-b818-49f9-ba6d-dab3c2f8493e-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-58d6a696-b818-49f9-ba6d-dab3c2f8493e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "cinder-quobyte-b6cb472f-db84-4f9a-815c-c4b318256973" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-b6cb472f-db84-4f9a-815c-c4b318256973" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "cinder-quobyte-58d6a696-b818-49f9-ba6d-dab3c2f8493e" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-58d6a696-b818-49f9-ba6d-dab3c2f8493e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Deleting offline snapshot 58d6a696-b818-49f9-ba6d-dab3c2f8493e of volume b6cb472f-db84-4f9a-815c-c4b318256973 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] snapshot_file for this snap is: volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[760d0eda-a2c2-48e3-9fbb-fa70ae03bab2]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:26 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333" returned: 0 in 0.427s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.769s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-18030184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970475d7-48b0-4ff2-949b-4c4118c8c49c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:20Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Creating volume 970475d7-48b0-4ff2-949b-4c4118c8c49c {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:26 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:26 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:26 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e05640d-5cbf-4f1e-8840-f8dde76f989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:26 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c 1073741824 Apr 09 13:39:26 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc1466d-0fce-435d-9854-83afcb8d09a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:26 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333 (130dc43b-8877-4a9d-adfe-ffad3d9bb333): created successfully Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc1466d-0fce-435d-9854-83afcb8d09a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (110e54c3-3150-4b08-b0eb-4759d69d10f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:26 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-a47d0362-ecfa-42ee-b95f-eab030db0711 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created volume successfully. Apr 09 13:39:26 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b.e30e0904-edc1-4436-a473-61a228d55221" returned: 0 in 0.440s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-e30e0904-edc1-4436-a473-61a228d55221" released by "_delete_snapshot" :: held 1.911s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-54033d1b-9993-44e1-a983-61647310fb1b" released by "delete_snapshot" :: held 1.925s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created reservations ['0a6f6bcc-6627-479e-be69-bbfb06c5dc2b', '5b6888c9-05aa-4010-9b27-00d5217a8da7', '81fcae76-b00d-4656-8c5b-f4a9719eed9d', 'a3dc0d90-2384-4c8d-b8ca-481599a7c9b8'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:26 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Delete snapshot completed successfully. Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2f425e5a-a83a-4a04-a60c-7b2758bf58d9 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-e30e0904-edc1-4436-a473-61a228d55221-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-54033d1b-9993-44e1-a983-61647310fb1b-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-54033d1b-9993-44e1-a983-61647310fb1b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "cinder-quobyte-54033d1b-9993-44e1-a983-61647310fb1b" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-54033d1b-9993-44e1-a983-61647310fb1b" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e385f93a-6d8c-4110-86aa-e950f0ae8c2a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:26 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b Apr 09 13:39:26 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:26 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e" returned: 0 in 0.587s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6cb472f-db84-4f9a-815c-c4b318256973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae1086b-d1bc-4ec6-bb1e-a1cd46dd8685]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:26 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c 1073741824" returned: 0 in 0.541s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:26 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:26 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c Apr 09 13:39:26 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:26 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 Apr 09 13:39:26 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:27 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b" returned: 0 in 0.538s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:27 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b Apr 09 13:39:27 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:27 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c" returned: 0 in 0.423s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:27 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.561s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1164611197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbdde2df-e5b2-4baf-a128-ab763fb9ed1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:21Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Creating volume fbdde2df-e5b2-4baf-a128-ab763fb9ed1d {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:27 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973" returned: 0 in 0.486s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:27 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d 1073741824 Apr 09 13:39:27 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d01110-2623-4148-bffa-652992f11500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970475d7-48b0-4ff2-949b-4c4118c8c49c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73814e79-ae51-44f3-85a7-bf96ee74aa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:27 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e Apr 09 13:39:27 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:27 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume volume-970475d7-48b0-4ff2-949b-4c4118c8c49c (970475d7-48b0-4ff2-949b-4c4118c8c49c): created successfully Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73814e79-ae51-44f3-85a7-bf96ee74aa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (742fe8cf-f72b-4e2a-9ee1-2d068d6b281f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:27 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-5cc1171e-dc51-462a-96f3-981261a90317 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created volume successfully. Apr 09 13:39:27 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-54033d1b-9993-44e1-a983-61647310fb1b" returned: 0 in 0.485s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-quobyte-54033d1b-9993-44e1-a983-61647310fb1b" released by "delete_volume" :: held 1.061s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Created reservations ['a7b9185d-07e8-4c04-91e5-399857bf098d', 'a2a27486-94a1-4f0e-8a7e-11f6c64d3ed4', '16477d77-f9b6-4c85-b693-9c531b54c434', '8a0224bd-7507-4ee3-bc19-780179effb67'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:27 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:27 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:27 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:27 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d 1073741824" returned: 0 in 0.530s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e" returned: 0 in 0.527s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:27 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e Apr 09 13:39:27 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:27 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:27 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d Apr 09 13:39:27 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:28 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.437s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:28 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Deleted volume successfully. Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b1bc3e43-7b58-4076-806c-873601b65f23 tempest-CreateVolumesFromSnapshotTest-1991837773 None] Lock "cinder-54033d1b-9993-44e1-a983-61647310fb1b-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:28 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973.58d6a696-b818-49f9-ba6d-dab3c2f8493e" returned: 0 in 0.422s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:28 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-58d6a696-b818-49f9-ba6d-dab3c2f8493e" released by "_delete_snapshot" :: held 2.079s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-b6cb472f-db84-4f9a-815c-c4b318256973" released by "delete_snapshot" :: held 2.092s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d" returned: 0 in 0.423s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.367s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2012559846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c27630-eed5-488b-83c4-149b6fd0961c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:21Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Creating volume 07c27630-eed5-488b-83c4-149b6fd0961c {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:28 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:28 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c 1073741824 Apr 09 13:39:28 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d1ac8f-fd2c-4a27-b482-20f5ce28d2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3efcbcc-4dd4-433c-9d77-2e2c67fb90eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:28 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d (fbdde2df-e5b2-4baf-a128-ab763fb9ed1d): created successfully Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3efcbcc-4dd4-433c-9d77-2e2c67fb90eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (f1ff277a-1b0f-4114-aa40-f51087e9fa96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:28 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-63336b69-178d-4e56-8572-bb1376bf4d7f tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created volume successfully. Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Created reservations ['0e361062-2b3d-4ff4-bc39-6bbd07d9d2c5', '329b1bc5-0ea1-4740-b13d-fee096cdf698', '5d69f8a6-5160-45e8-9e40-04fce73417a4', 'add44541-5483-4b8e-961d-3ac5675f74c1'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:28 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Delete snapshot completed successfully. Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6418f2af-1b65-42f8-9e40-d341893915a3 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-58d6a696-b818-49f9-ba6d-dab3c2f8493e-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:28 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c 1073741824" returned: 0 in 0.493s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:28 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:28 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c Apr 09 13:39:28 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:29 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c" returned: 0 in 0.435s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.045s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794327827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5cb77b-3ea2-42dd-8284-9bfed74e8d71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32ed400919a4101b73055e6bbbfcbda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:21Z,use_quota=True,user_id='0e0d0751ece04ae898bb7cd6cb0c4244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Creating volume aa5cb77b-3ea2-42dd-8284-9bfed74e8d71 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:29 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea1e8d3-a75b-4279-9680-3940f6b3b213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c27630-eed5-488b-83c4-149b6fd0961c', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830bd435-6856-411c-9a77-61a013bd5a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:29 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71 1073741824 Apr 09 13:39:29 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:29 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume volume-07c27630-eed5-488b-83c4-149b6fd0961c (07c27630-eed5-488b-83c4-149b6fd0961c): created successfully Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830bd435-6856-411c-9a77-61a013bd5a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (bbcc1fc5-ac42-410a-b915-98daa72f046f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:29 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-862d268b-ca35-444a-92a0-177a469c5b27 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created volume successfully. Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "cinder-b6cb472f-db84-4f9a-815c-c4b318256973-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-b6cb472f-db84-4f9a-815c-c4b318256973-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "cinder-quobyte-b6cb472f-db84-4f9a-815c-c4b318256973" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-b6cb472f-db84-4f9a-815c-c4b318256973" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[431a235e-415f-4789-9d71-b59433740750]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:29 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 Apr 09 13:39:29 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:29 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71 1073741824" returned: 0 in 0.602s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:29 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:29 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71 Apr 09 13:39:29 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:30 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973" returned: 0 in 0.597s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:30 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973 Apr 09 13:39:30 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:30 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71" returned: 0 in 0.464s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.925s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:30 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Cloning volume a007dd2d-10de-4343-b3a3-50d12b20ce4b to volume 19ee7376-ab3c-490d-abfe-3b1983a3de44 Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7792d42-774d-4969-9ed8-850b4b55248f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934709d2-57b0-455e-b648-c02f5d4522ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:30 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Volume volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71 (aa5cb77b-3ea2-42dd-8284-9bfed74e8d71): created successfully Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934709d2-57b0-455e-b648-c02f5d4522ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Flow 'volume_create_manager' (06043cdd-60bc-41a2-bf8b-5255cbd66ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Creating offline snapshot 427bd8ce-70fa-4dbf-8a02-b25351f66fc0 of volume a007dd2d-10de-4343-b3a3-50d12b20ce4b {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:39:30 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b6ae2a80-3261-4f8b-8483-7a9b1b872ce6 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created volume successfully. Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69eac7f-542d-4c05-a231-331037701551]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:30 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b6cb472f-db84-4f9a-815c-c4b318256973" returned: 0 in 0.432s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-b6cb472f-db84-4f9a-815c-c4b318256973" released by "delete_volume" :: held 1.061s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Created reservations ['0c376613-9254-4f49-ae59-18d3004d6fea', '421df1e4-d8a7-4e87-b0fe-207846c4f7d5', '674ea805-0119-4863-b662-ea3f00647d15', '9c5ecec9-8956-4a9d-814a-8d9b2bd80205'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:30 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b Apr 09 13:39:30 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:30 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:30 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Flow 'volume_create_manager' (8c8fbdfb-773d-4587-b3b7-a33219915687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4ed588-34a9-4b6e-9793-ce9240aa458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4ed588-34a9-4b6e-9793-ce9240aa458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86dae11c-6f31-4da4-8dd2-1011929cdf8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad93ad4c84481f8dd0f759b7dbf46c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:31Z,use_quota=True,user_id='c535dab1026f430a810a44050a997ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6645a882-273e-486c-a7ea-631681f10af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6645a882-273e-486c-a7ea-631681f10af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f2fc93-c28d-4c06-80d4-9d7e74060910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f2fc93-c28d-4c06-80d4-9d7e74060910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86dae11c-6f31-4da4-8dd2-1011929cdf8e', 'volume_name': 'volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fc13e1-c67a-4adb-8e4b-1fffd26bcfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fc13e1-c67a-4adb-8e4b-1fffd26bcfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a8b4ae-ea0f-43c3-a30a-ac86dbe3e723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:30 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Volume 86dae11c-6f31-4da4-8dd2-1011929cdf8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e', 'volume_size': 1} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-quobyte-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf9caec-2fa1-4e2a-b1ee-4506704171c8]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:30 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:31 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b" returned: 0 in 0.569s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:31 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.475s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:31 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Deleted volume successfully. Apr 09 13:39:31 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 1G Apr 09 13:39:31 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-2fe4c8d6-71da-469b-935d-f00f24ed33f1 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-b6cb472f-db84-4f9a-815c-c4b318256973-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:31 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71 Apr 09 13:39:31 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:31 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71" returned: 0 in 0.510s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:31 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 1G" returned: 0 in 0.490s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:31 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71 Apr 09 13:39:31 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:31 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 Apr 09 13:39:31 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "cinder-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "cinder-quobyte-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[182e0d07-c1d5-4570-949c-78b651c0647f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:31 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 Apr 09 13:39:31 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:31 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71" returned: 0 in 0.468s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:31 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71" released by "delete_volume" :: held 0.999s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0" returned: 0 in 0.472s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:31 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 is being set with open permissions: ugo+rw Apr 09 13:39:31 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:31 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 Apr 09 13:39:31 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created reservations ['4b86d6fa-2ab6-42b4-a9af-74114afe45a7', '3f5b7eb3-5ab7-4dec-90e3-f0bf3eab0e62', '5da96558-a179-4737-ab21-46261f7183b8', 'ead11b0c-c98d-407d-8775-f22e9dad8ff5'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:32 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:32 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:32 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" returned: 0 in 0.495s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:32 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509 Apr 09 13:39:32 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:32 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0" returned: 0 in 0.440s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:UPDATE=224,cinder:DELETE=18,cinder:SELECT=158,cinder:INSERT=49 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:32 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.info Apr 09 13:39:32 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:32 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.415s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:32 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Deleted volume successfully. Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-1469703e-c00d-4e27-a14b-807a994bd4b3 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-aa5cb77b-3ea2-42dd-8284-9bfed74e8d71-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:32 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" returned: 0 in 0.432s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-quobyte-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509" released by "delete_volume" :: held 0.949s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Created reservations ['0d6daa3b-7153-4095-8da0-f2b2491f56d1', '0b3fb4ad-5d39-4ad7-8512-03798b676bc3', '3f03c844-9369-4e14-98ab-5920cc1a16cd', 'bd3a3230-b292-41c9-9e4e-9139d6ed2f8c'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:32 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:32 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:32 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.info" returned: 0 in 0.484s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:32 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.info is being set with open permissions: ugo+rw Apr 09 13:39:32 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:32 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.info Apr 09 13:39:32 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:33 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-07c27630-eed5-488b-83c4-149b6fd0961c-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.467s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:33 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Deleted volume successfully. Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-07c27630-eed5-488b-83c4-149b6fd0961c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-b419006f-6213-45ea-a5f1-2f8d9b41d509 tempest-SnapshotDependencyTests-792036205 None] Lock "cinder-4f360e32-dc8b-4d7f-bdda-ac6ce0cf3509-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-quobyte-07c27630-eed5-488b-83c4-149b6fd0961c" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-07c27630-eed5-488b-83c4-149b6fd0961c" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3705aa7-a1a9-4690-8419-c6e0097199d6]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:33 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c Apr 09 13:39:33 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:33 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.info" returned: 0 in 0.507s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-quobyte-19ee7376-ab3c-490d-abfe-3b1983a3de44" by "_copy_volume_from_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-19ee7376-ab3c-490d-abfe-3b1983a3de44" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] snapshot: 427bd8ce-70fa-4dbf-8a02-b25351f66fc0, volume: 19ee7376-ab3c-490d-abfe-3b1983a3de44, {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebda3a07-8362-4048-9ed6-863febe39e4f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:33 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 Apr 09 13:39:33 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:33 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c" returned: 0 in 0.544s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:33 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:33 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c Apr 09 13:39:33 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:34 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0" returned: 0 in 0.549s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Creating direct copy from snapshot {{(pid=82346) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[159b4d0f-c174-4ad7-a88e-be14c3f50381]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:34 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b Apr 09 13:39:34 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:34 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-07c27630-eed5-488b-83c4-149b6fd0961c" returned: 0 in 0.513s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-07c27630-eed5-488b-83c4-149b6fd0961c" released by "delete_volume" :: held 1.080s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG dbcounter [-] [82346] Writing DB stats cinder:SELECT=184,cinder:UPDATE=233,cinder:INSERT=60,cinder:DELETE=27 {{(pid=82346) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created reservations ['e1ac1f19-8051-4850-b6ae-c28bd584d6c3', '29915da8-b730-4832-894e-79220962639b', '5e2ff8bc-577d-4d68-be72-79520db6bd46', '209f7fc6-2689-4d9f-ab42-2a166dcdc610'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:34 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:34 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:34 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b" returned: 0 in 0.590s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG cinder.utils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Path /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 not found in is_blk_device check {{(pid=82346) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:34 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 Apr 09 13:39:34 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:34 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.469s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:34 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Deleted volume successfully. Apr 09 13:39:34 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-058ccb94-69ea-458d-acfa-8f4a60a7e2f4 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-07c27630-eed5-488b-83c4-149b6fd0961c-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-quobyte-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:35 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d" acquired by "delete_volume" :: waited 0.039s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:35 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09e2b57-d8e7-4ecf-89e8-d839754f4721]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:35 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:35 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d Apr 09 13:39:35 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:36 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d" returned: 0 in 1.276s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:36 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44" returned: 0 in 2.263s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:36 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c557df6-cc11-4f0a-aeb8-760a027c4c0f]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:36 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:36 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d Apr 09 13:39:36 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:36 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b Apr 09 13:39:37 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:37 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d" returned: 0 in 0.505s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d" released by "delete_volume" :: held 1.822s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created reservations ['be00f743-f8ee-429d-b10d-b9ffd6f4c8a9', 'c6a76bf2-c284-4e92-8459-4f7f2d0db02c', '1aae517e-7462-4d54-a078-cd5e69582f16', 'eeed0570-bdac-4888-a021-3a9beff873ca'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:37 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:37 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:37 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b" returned: 0 in 0.688s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG cinder.image.image_utils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Image conversion details: src /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 {{(pid=82346) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 09 13:39:37 devstack cinder-volume[82346]: INFO cinder.image.image_utils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Converted 1024.00 MB image at 452.09 MB/s Apr 09 13:39:37 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 is being set with open permissions: ugo+rw Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:37 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 Apr 09 13:39:37 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-970475d7-48b0-4ff2-949b-4c4118c8c49c-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-970475d7-48b0-4ff2-949b-4c4118c8c49c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-quobyte-970475d7-48b0-4ff2-949b-4c4118c8c49c" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-970475d7-48b0-4ff2-949b-4c4118c8c49c" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa29c9ce-21d5-4d93-bf99-2c310752f85e]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:37 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c Apr 09 13:39:37 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:37 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.410s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:37 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Deleted volume successfully. Apr 09 13:39:37 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6ba2dad3-3c11-4ede-a0ca-76ffb0f704d1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-fbdde2df-e5b2-4baf-a128-ab763fb9ed1d-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:38 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44" returned: 0 in 0.577s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-19ee7376-ab3c-490d-abfe-3b1983a3de44" released by "_copy_volume_from_snapshot" :: held 4.716s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-quobyte-427bd8ce-70fa-4dbf-8a02-b25351f66fc0" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-427bd8ce-70fa-4dbf-8a02-b25351f66fc0" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Deleting offline snapshot 427bd8ce-70fa-4dbf-8a02-b25351f66fc0 of volume a007dd2d-10de-4343-b3a3-50d12b20ce4b {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] snapshot_file for this snap is: volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b196ef-aa8e-4ca9-8044-f873ffee9554]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:38 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 Apr 09 13:39:38 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:38 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c" returned: 0 in 0.561s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:38 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c Apr 09 13:39:38 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:38 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0" returned: 0 in 0.558s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c808ab-dead-4fd5-94d4-fd7d27e1e4c7]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:38 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b Apr 09 13:39:38 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:38 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-970475d7-48b0-4ff2-949b-4c4118c8c49c" returned: 0 in 0.523s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-970475d7-48b0-4ff2-949b-4c4118c8c49c" released by "delete_volume" :: held 1.113s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:38 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created reservations ['f97f3369-a64a-469b-b0db-10bdb0096396', '2655eb4b-22f9-492b-b667-580476cb45dc', '8f473c5c-4c0c-467f-a801-1ea63c7ccfac', '67bc045b-f63c-43bc-974c-1f3a55014ff9'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:39 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:39 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:39 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b" returned: 0 in 0.589s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:39 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 Apr 09 13:39:39 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:39 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.519s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:39 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Deleted volume successfully. Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-601bbb56-d72d-4b83-aa13-4d5ef5002d22 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-970475d7-48b0-4ff2-949b-4c4118c8c49c-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:39 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0" returned: 0 in 0.563s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:39 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:39 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0 Apr 09 13:39:39 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-130dc43b-8877-4a9d-adfe-ffad3d9bb333-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-130dc43b-8877-4a9d-adfe-ffad3d9bb333-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-quobyte-130dc43b-8877-4a9d-adfe-ffad3d9bb333" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-130dc43b-8877-4a9d-adfe-ffad3d9bb333" acquired by "delete_volume" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2376cb-b19c-4945-821a-30ece88bc9f4]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:40 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333 Apr 09 13:39:40 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:40 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b.427bd8ce-70fa-4dbf-8a02-b25351f66fc0" returned: 0 in 0.487s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-427bd8ce-70fa-4dbf-8a02-b25351f66fc0" released by "_delete_snapshot" :: held 2.256s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.102s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.740s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86dae11c-6f31-4da4-8dd2-1011929cdf8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad93ad4c84481f8dd0f759b7dbf46c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:31Z,use_quota=True,user_id='c535dab1026f430a810a44050a997ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Creating volume 86dae11c-6f31-4da4-8dd2-1011929cdf8e {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:40 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:40 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e 1073741824 Apr 09 13:39:40 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9af25a9-59ae-44fb-94e9-b4c9a0a63c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ee7376-ab3c-490d-abfe-3b1983a3de44', 'volume_size': 1, 'source_volid': 'a007dd2d-10de-4343-b3a3-50d12b20ce4b', 'source_volstatus': 'available'}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77322110-6131-4607-871c-fc56c8cfa989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:40 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Volume volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 (19ee7376-ab3c-490d-abfe-3b1983a3de44): created successfully Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77322110-6131-4607-871c-fc56c8cfa989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Flow 'volume_create_manager' (858c42d4-c2d5-46e5-bad2-0cda5d40acfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:40 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6fc2bc76-8708-4531-8fdb-5f879d63c420 tempest-VolumeDependencyTests-1544341491 None] Created volume successfully. Apr 09 13:39:40 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333" returned: 0 in 0.492s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:40 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333 Apr 09 13:39:40 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:40 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e 1073741824" returned: 0 in 0.471s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:40 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:40 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e Apr 09 13:39:40 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:41 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-130dc43b-8877-4a9d-adfe-ffad3d9bb333" returned: 0 in 0.420s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-130dc43b-8877-4a9d-adfe-ffad3d9bb333" released by "delete_volume" :: held 0.942s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created reservations ['c8781e1f-b733-4ade-a3ab-ad9b73d09692', '50563b5b-d54c-449a-8885-a8cedbfdbd24', '96ed1536-7907-4380-8c6d-660aee7df6a9', 'fb81e88d-bf6d-4b1d-8834-f2f3de9070f2'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:41 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:41 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-b16c23e5-ee52-45a5-9616-6c8150ef509a-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-b16c23e5-ee52-45a5-9616-6c8150ef509a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "cinder-quobyte-b16c23e5-ee52-45a5-9616-6c8150ef509a" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-b16c23e5-ee52-45a5-9616-6c8150ef509a" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[8734fcfa-f6a5-45a3-a394-3c4de229fe59]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:41 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a Apr 09 13:39:41 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:41 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e" returned: 0 in 0.430s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a8b4ae-ea0f-43c3-a30a-ac86dbe3e723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e6fe14-5df3-4db7-8622-81bccfc63a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:41 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Volume volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e (86dae11c-6f31-4da4-8dd2-1011929cdf8e): created successfully Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e6fe14-5df3-4db7-8622-81bccfc63a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Flow 'volume_create_manager' (8c8fbdfb-773d-4587-b3b7-a33219915687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:41 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-d2a2df30-49ef-4fbc-bf41-ec9b1c763e3e tempest-CinderUnicodeTest-1965263298 None] Created volume successfully. Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-a007dd2d-10de-4343-b3a3-50d12b20ce4b-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-a007dd2d-10de-4343-b3a3-50d12b20ce4b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-quobyte-a007dd2d-10de-4343-b3a3-50d12b20ce4b" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-a007dd2d-10de-4343-b3a3-50d12b20ce4b" acquired by "delete_volume" :: waited 0.012s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf85f01f-b811-44f0-8de4-3fbdc9c58ad2]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:41 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.457s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:41 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Deleted volume successfully. Apr 09 13:39:41 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b Apr 09 13:39:41 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-605a5001-da7b-4e64-93a5-09d3e36a97e1 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-130dc43b-8877-4a9d-adfe-ffad3d9bb333-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:41 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a" returned: 0 in 0.516s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:41 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a Apr 09 13:39:41 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:41 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b" returned: 0 in 0.469s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:41 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:42 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b Apr 09 13:39:42 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:42 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-b16c23e5-ee52-45a5-9616-6c8150ef509a" returned: 0 in 0.390s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-quobyte-b16c23e5-ee52-45a5-9616-6c8150ef509a" released by "delete_volume" :: held 0.929s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Created reservations ['39843d8b-6548-40af-ae89-b1c32d8cb5de', 'eee69753-0b05-48dc-8097-5a5d7463d49c', '8b0179bf-e04b-4787-b87f-6e4ebf4644d9', 'ecc6ca74-1342-4352-97fb-dca4189ffdaa'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:42 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:42 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:42 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-a007dd2d-10de-4343-b3a3-50d12b20ce4b" returned: 0 in 0.470s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-a007dd2d-10de-4343-b3a3-50d12b20ce4b" released by "delete_volume" :: held 0.968s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Created reservations ['0ada12c2-d865-4fe1-8ca0-b08fd021c1cf', '70f5097a-ac1e-4723-9e30-81e6f797e2e0', '29b91d71-58bc-4a54-a280-812321cd7034', '89de7d7b-39e0-45a8-a1c4-94f6eebd2f91'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:42 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:42 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82346) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Flow 'volume_create_manager' (0d490563-3985-439c-9921-651a25cfaf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9a2d72-b223-45f9-a9ec-c30f023e0caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:42 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9a2d72-b223-45f9-a9ec-c30f023e0caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2068713530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e86f53-dede-4550-8034-ed342a91aae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad93ad4c84481f8dd0f759b7dbf46c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:43Z,use_quota=True,user_id='c535dab1026f430a810a44050a997ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b11ee1-8d3d-4e93-a157-1c8b9fce5eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b11ee1-8d3d-4e93-a157-1c8b9fce5eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bda4df-274a-4ba3-babf-b4aa58c6ef7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bda4df-274a-4ba3-babf-b4aa58c6ef7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e86f53-dede-4550-8034-ed342a91aae8', 'volume_name': 'volume-23e86f53-dede-4550-8034-ed342a91aae8', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb1c6ed-4ac1-4c8e-828b-0e891c8d2100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb1c6ed-4ac1-4c8e-828b-0e891c8d2100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8b835f-966a-4d7e-8ed6-57b6d7331498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:42 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Volume 23e86f53-dede-4550-8034-ed342a91aae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e86f53-dede-4550-8034-ed342a91aae8', 'volume_size': 1} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-09T11:39:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2068713530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e86f53-dede-4550-8034-ed342a91aae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fad93ad4c84481f8dd0f759b7dbf46c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-09T11:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-09T11:39:43Z,use_quota=True,user_id='c535dab1026f430a810a44050a997ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2933e2-8e79-4888-99b8-56483d10755f),volume_type_id=cc2933e2-8e79-4888-99b8-56483d10755f)}" {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Creating volume 23e86f53-dede-4550-8034-ed342a91aae8 {{(pid=82346) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Selected osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 as target Quobyte volume. {{(pid=82346) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 09 13:39:42 devstack cinder-volume[82346]: INFO cinder.volume.drivers.remotefs [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] casted to osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0 Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 1073741824 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.592s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:42 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Deleted volume successfully. Apr 09 13:39:42 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 1073741824 Apr 09 13:39:42 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:42 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-6d932aa8-5224-49cc-a100-3d6cc934dc39 tempest-CreateVolumesFromSourceVolumeTest-640403762 None] Lock "cinder-b16c23e5-ee52-45a5-9616-6c8150ef509a-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:43 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.461s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:43 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Deleted volume successfully. Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-cc1b0da9-19d2-444c-b06c-06f14e1f76f4 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-a007dd2d-10de-4343-b3a3-50d12b20ce4b-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:43 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 1073741824" returned: 0 in 0.548s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:43 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 Apr 09 13:39:43 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-19ee7376-ab3c-490d-abfe-3b1983a3de44-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-19ee7376-ab3c-490d-abfe-3b1983a3de44-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-quobyte-19ee7376-ab3c-490d-abfe-3b1983a3de44" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-19ee7376-ab3c-490d-abfe-3b1983a3de44" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c0d593-7c20-470e-aeee-7608a060582a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:43 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8" returned: 0 in 0.431s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'} {{(pid=82346) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:43 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 Apr 09 13:39:43 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8b835f-966a-4d7e-8ed6-57b6d7331498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e86f53-dede-4550-8034-ed342a91aae8', 'volume_size': 1}' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b472d2e-8c59-4e2b-8939-fbb4539b446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 09 13:39:43 devstack cinder-volume[82346]: INFO cinder.volume.flows.manager.create_volume [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Volume volume-23e86f53-dede-4550-8034-ed342a91aae8 (23e86f53-dede-4550-8034-ed342a91aae8): created successfully Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b472d2e-8c59-4e2b-8939-fbb4539b446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82346) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 09 13:39:43 devstack cinder-volume[82346]: DEBUG cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Flow 'volume_create_manager' (0d490563-3985-439c-9921-651a25cfaf79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82346) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 09 13:39:43 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-06ba8894-a752-42f2-8121-168a53578adc tempest-CinderUnicodeTest-1965263298 None] Created volume successfully. Apr 09 13:39:44 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44" returned: 0 in 0.458s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:44 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44 Apr 09 13:39:44 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:44 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-19ee7376-ab3c-490d-abfe-3b1983a3de44" returned: 0 in 0.393s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-19ee7376-ab3c-490d-abfe-3b1983a3de44" released by "delete_volume" :: held 0.869s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Created reservations ['184fd8e3-a7b1-452a-8b35-0da5646e04e8', 'aaec6c69-623f-41b4-b70a-eb030be6d471', '849774b0-3dc0-4c72-a4b7-8f36a7d5d156', '60d51f9e-01bb-44e1-9d93-3c4aea219bd1'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:44 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:44 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-d3140b77-9f66-4515-833c-b17788689719-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-d3140b77-9f66-4515-833c-b17788689719-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "cinder-quobyte-d3140b77-9f66-4515-833c-b17788689719" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-d3140b77-9f66-4515-833c-b17788689719" acquired by "delete_volume" :: waited 0.011s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[571b5575-76b0-409a-a4f6-2ab4b090422d]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:44 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:45 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719 Apr 09 13:39:45 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] Creating offline snapshot c75d19b4-00e1-4ee6-90a6-6648c13d4b1e of volume 23e86f53-dede-4550-8034-ed342a91aae8 {{(pid=82346) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de90002-b0c1-47af-951a-625c7f6a3bc2]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:45 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.411s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:45 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Deleted volume successfully. Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-729a1fb8-0542-41fe-b902-fe710a5852cb tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-19ee7376-ab3c-490d-abfe-3b1983a3de44-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:45 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 Apr 09 13:39:45 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:45 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719" returned: 0 in 0.517s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:45 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719 Apr 09 13:39:45 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:45 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8" returned: 0 in 0.465s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e 1G {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:45 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e 1G Apr 09 13:39:45 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:45 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-d3140b77-9f66-4515-833c-b17788689719" returned: 0 in 0.399s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-quobyte-d3140b77-9f66-4515-833c-b17788689719" released by "delete_volume" :: held 0.939s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Created reservations ['017b91ab-673a-46dc-b93b-c7d86aad12cf', 'fa1eaba6-8e96-42f8-9aec-3b27967f4d8f', 'c36d207d-59e4-472e-aadb-ff5653bc02aa', '6bd85827-3c0c-4129-a27e-482d5e5bdcd9'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:45 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:45 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:45 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:46 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e 1G" returned: 0 in 0.505s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e86f53-dede-4550-8034-ed342a91aae8 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:46 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e86f53-dede-4550-8034-ed342a91aae8 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e Apr 09 13:39:46 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:46 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.501s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:46 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:46 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Deleted volume successfully. Apr 09 13:39:46 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e86f53-dede-4550-8034-ed342a91aae8 -F qcow2 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e" returned: 0 in 0.429s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:46 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e is being set with open permissions: ugo+rw Apr 09 13:39:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:46 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-219b6c8e-cf13-44e3-bba1-a38871719000 tempest-VolumeDependencyTests-1544341491 None] Lock "cinder-d3140b77-9f66-4515-833c-b17788689719-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:46 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e Apr 09 13:39:46 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:46 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e" returned: 0 in 0.447s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:46 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:46 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.info Apr 09 13:39:46 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:47 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.info" returned: 0 in 0.402s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:47 devstack cinder-volume[82346]: WARNING cinder.volume.drivers.remotefs [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.info is being set with open permissions: ugo+rw Apr 09 13:39:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.info {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:47 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.info Apr 09 13:39:47 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:47 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.info" returned: 0 in 0.401s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:47 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:47 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-20589ab0-2520-4881-b757-4cc8b0fea0e2 tempest-CinderUnicodeTest-1965263298 None] Create snapshot completed successfully Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "cinder-c75d19b4-00e1-4ee6-90a6-6648c13d4b1e-delete_snapshot" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-c75d19b4-00e1-4ee6-90a6-6648c13d4b1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "cinder-quobyte-23e86f53-dede-4550-8034-ed342a91aae8" by "delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-quobyte-23e86f53-dede-4550-8034-ed342a91aae8" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "cinder-quobyte-c75d19b4-00e1-4ee6-90a6-6648c13d4b1e" by "_delete_snapshot" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-quobyte-c75d19b4-00e1-4ee6-90a6-6648c13d4b1e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Deleting offline snapshot c75d19b4-00e1-4ee6-90a6-6648c13d4b1e of volume 23e86f53-dede-4550-8034-ed342a91aae8 {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] snapshot_file for this snap is: volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e {{(pid=82346) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cec7f3-eb74-40af-8ee2-b2cd22d09dda]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:48 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e Apr 09 13:39:48 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:48 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e" returned: 0 in 0.438s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.remotefs [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e86f53-dede-4550-8034-ed342a91aae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82346) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e0cd1b-bdbc-48c9-b1f2-bb6a73fecbbc]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:48 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:48 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 Apr 09 13:39:48 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:49 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8" returned: 0 in 0.442s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:49 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e Apr 09 13:39:49 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:49 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e" returned: 0 in 0.425s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:49 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e Apr 09 13:39:49 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:49 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:49 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8.c75d19b4-00e1-4ee6-90a6-6648c13d4b1e" returned: 0 in 0.387s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-quobyte-c75d19b4-00e1-4ee6-90a6-6648c13d4b1e" released by "_delete_snapshot" :: held 1.741s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-quobyte-23e86f53-dede-4550-8034-ed342a91aae8" released by "delete_snapshot" :: held 1.753s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:49 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Created reservations ['4d0573dd-bc74-4e4b-b050-760e8092cbbe', 'b69047d2-9631-4d18-99bf-7f987b69f16e', 'c2109178-0724-4bc2-b330-1310439de8d6', 'c2093ddc-f0ad-4a15-9cda-960072905b18'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:49 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Delete snapshot completed successfully. Apr 09 13:39:49 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-c428e6ed-e6b4-4ba5-9511-2a20c04a060a tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-c75d19b4-00e1-4ee6-90a6-6648c13d4b1e-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:50 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "cinder-23e86f53-dede-4550-8034-ed342a91aae8-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:50 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-23e86f53-dede-4550-8034-ed342a91aae8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:50 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "cinder-quobyte-23e86f53-dede-4550-8034-ed342a91aae8" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:50 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-quobyte-23e86f53-dede-4550-8034-ed342a91aae8" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:50 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee290b0-05e5-478b-81ee-08a2ff96fb75]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:50 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 Apr 09 13:39:50 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:50 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8" returned: 0 in 0.438s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:50 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:50 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8 Apr 09 13:39:50 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:51 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-23e86f53-dede-4550-8034-ed342a91aae8" returned: 0 in 0.387s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-quobyte-23e86f53-dede-4550-8034-ed342a91aae8" released by "delete_volume" :: held 0.855s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Created reservations ['12d1aaca-fa23-4fc3-a89f-5c4d3f364438', 'ff9e46fc-d455-41fc-87e5-86fd1724d61e', '72ca881a-0d89-48ba-9d83-6ac1c4e126a1', '7fae945e-d8f0-444e-bd3f-7342e2634ca9'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:51 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:51 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "cinder-86dae11c-6f31-4da4-8dd2-1011929cdf8e-delete_volume" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-86dae11c-6f31-4da4-8dd2-1011929cdf8e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "cinder-quobyte-86dae11c-6f31-4da4-8dd2-1011929cdf8e" by "delete_volume" {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-quobyte-86dae11c-6f31-4da4-8dd2-1011929cdf8e" acquired by "delete_volume" :: waited 0.008s {{(pid=82346) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG oslo.privsep.daemon [-] privsep: reply[548434af-52f9-4508-b511-5967bebc5b7a]: (4, 'qcow2') {{(pid=83319) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:51 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e Apr 09 13:39:51 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:51 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.431s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:51 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Deleted volume successfully. Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-86ec9c73-6a7f-4915-8c0f-a867c000d05c tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-23e86f53-dede-4550-8034-ed342a91aae8-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:51 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e" returned: 0 in 0.469s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:51 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:51 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e Apr 09 13:39:51 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:52 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de/volume-86dae11c-6f31-4da4-8dd2-1011929cdf8e" returned: 0 in 0.388s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-quobyte-86dae11c-6f31-4da4-8dd2-1011929cdf8e" released by "delete_volume" :: held 0.875s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG cinder.quota [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Created reservations ['72dcdb78-c456-4640-8e6b-78fb14f4f3e0', 'f5c60836-f237-483c-b997-9a642b01a2e3', '2f817f53-73f3-4207-8504-95fd8b54486a', 'a7cdaf53-5e55-4862-9f32-a18f2a4d04e8'] {{(pid=82346) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0': None} {{(pid=82346) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG cinder.volume.drivers.quobyte [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0de137bb-00a8-451c-9c2d-76effd4259f0'] {{(pid=82346) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.lockutils [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82346) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 09 13:39:52 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de Apr 09 13:39:52 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 09 13:39:52 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG oslo_concurrency.processutils [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25b04390d3475867d515a2de3ad307de" returned: 0 in 0.429s {{(pid=82346) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG cinder.manager [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Notifying Schedulers of capabilities ... {{(pid=82346) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 09 13:39:52 devstack cinder-volume[82346]: INFO cinder.volume.manager [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Deleted volume successfully. Apr 09 13:39:52 devstack cinder-volume[82346]: DEBUG cinder.coordination [None req-9f9521c6-8a62-4d4e-8d70-601eae7d62cb tempest-CinderUnicodeTest-1965263298 None] Lock "cinder-86dae11c-6f31-4da4-8dd2-1011929cdf8e-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=82346) __release /opt/stack/cinder/cinder/coordination.py:152}}